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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment which, for the first time in the 
NAEP's history, made voluntary state-by-state assessments. This 1992 
mathematics report marks the first attempt of the National Center for 
Education Statistics (NCES) to shift to standards -based reporting of National 
Assessment statistics. NAEP results are reported by achievement levels which 
are descriptions of how students should perform relative to a body of content 
reflected in the NAEP frameworks; in other words, how much students should 
know. The 1992 assessment covered six mathematics content areas: (1) numbers 

and operations; (2) measurement; (3) geometry; (4) data analysis, statistics, 
and probability; (5) algebra and functions; and (6) estimation. In Kentucky, 
2,703 fourth-grade students in 118 public schools and 2,756 eighth-grade 
students in 104 public schools were assessed. This report describes the 
mathematics performance of Kentucky fourth- and eighth-grade students in 
public schools and compares their overall performance to students in the 
Southeast region of the United States and the nation. The distribution of the 
results are provided for subpopulations of students including race/ethnicity; 
type of community- -advantaged/disadvantaged urban, extreme rural, and other; 
parents* education level; gender; and content area performance. To provide a 
context for understanding students* mathematics proficiency, students, their 
mathematics teachers, and principals completed questionnaires which focused 
on: what are students taught? (curriculum coverage, homework, and 
instructional emphasis) ; how is mathematics instruction delivered? 

(resources, collaborating in small groups, using mathematical objects, and 
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materials) ; how are calculators and computers used? (access and use of 
calculators, availability of computers, and when to use a calculator) ; who is 
teaching mathematics? (educational background) ; and conditions beyond school 
that facilitate mathematics learning and teaching (amount of reading 
materials in the home, hours of television watched per day, student 
absenteeism, and students' perceptions of mathematics). The average 
proficiency of fourth-grade students in Kentucky on the NAEP mathematics 
scale was 214 compared to 217 nationwide; for Kentucky eighth-grade students 
the average proficiency was 261 compared to 266 nationwide. (ASK) 
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The National Assessment of Educational Progress (NAEP) is a Congressionally mandated project of the 
National Center for Education Statistics (NCES) that has collected and reported information for nearly 25 
years on what American students know and what they can do. It is the nation’s only ongoing, comparable, 
and representative assessment of student achievement. Its tests are given to scientific samples of youths 
attending both public and private schools and enrolled in grades four, eight, or twelve. The test items are 
written around a framework prepared for each content area — reading, writing, mathematics, science, and 
others -- that represents the consensus of groups of curriculum experts, educators, members of the general 
public, and user groups on what should be covered on such a test. Reporting includes means and 
distributions of scores, as well as more descriptive information about the meaning of different points on the 
NAEP scale. 



A Recent History of NAEP Reporting 



Over time there have been many changes in emphasis of NAEP testing and reporting both to take advantage 
of new technologies and to reflect changing trends in education. In 1984, a new technology called Item 
Response Theory (IRT) made it possible to create “scale scores” for NAEP similar to those the public was 
accustomed to seeing for the annual Scholastic Aptitude Tests (SAT). Educational Testing Service, in its 
role as Government grantee carrying out NAEP operations, devised a new way to describe performance 
against this scale, called “anchor levels.” Starting in 1984, NAEP results were reported by “anchor levels.” 
Anchor levels describe distributions of performance at selected points along the NAEP scale (i.e., standard 
deviation units). Anchor levels show how groups of students perform relative to each other, but not 
whether this performance is adequate. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and territories to participate 
voluntarily in a trial state assessment, using samples representative of their own students, to provide 
state-level data comparable to the nation and each of the other participating jurisdictions. Pursuant to that 
law, in 1990, the mathematics achievement of eighth graders was assessed in 40 jurisdictions (states, 
territories, and the District of Columbia). The results were reported in The State of Mathematics 
Achievement: NAEP's 1990 Assessment of the Nation and the Trial Assessment of the States (Washington, 
DC: National Center for Education Statistics, 1991). . 
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In the same 1988 law, Congress established the National Assessment Governing Board (NAGB), assigning 
it broad policy making authority over NAEP, including the authority to take “appropriate actions ... to 



translated into ranges along the NAEP scale. The process was conducted for NAGB under contract by 
American College Testing (ACT), which has extensive experience in standard-setting in many fields. The 
standards setting process began with questions such as, “What should students know and be able to do if 
they are proficient in mathematics in the fourth, eighth, or twelfth grade?” The National Assessment 
Governing Board, after wide consultation including public hearings, developed statements to describe what 
students should know and be able to do at three levels of proficiency — “Basic,” “Proficient,” and 
“Advanced” — for each of the three NAEP grades. A panel of expert and broadly representative judges 
evaluated each NAEP item, judged the proportion of students at each level which should answer the items 
correctly, and made recommendations that resulted in points along the NAEP scale that corresponded with 
the minimum score for each of these levels. 

In 1990, after Congress had mandated pilot testing at the State level to supplement what had only been 
conducted for the Nation and four large regions, the more rigorous content of the mathematics standards 
prepared by the National Council of Teachers of Mathematics began to influence the NAEP frameworks. 

Also in 1990, the President and the nations’s 50 governors adopted six National Education Goals, including 
one that calls for American students to “leave grades 4, 8, and 12 having demonstrated competency in 
challenging subject matter, including English, mathematics, science, history, and geography.” The adoption 
of this goal highlighted a perceived deficiency in the Nation’s ability to report on the performance of 
students relative to standards developed through a consensus process. 

A Transition Phase in Reporting 

Tins 1992 mathematics report marks NCES’s first attempt to shift to standards-based reporting of National 
Assessment statistics. The transition is being made now to report NAEP results by “achievement levels.” 
Achievement levels describe how students should perform relative to a body of content reflected in the 
NAEP frameworks (i.e., how much students should know). The impetus for this shift lies in the belief that 
NAEP data will take on more meaning for the public if they show what proportion of our youth are able 
to meet standards of performance necessary for a changing world. Chapter 1 of the report describes how 
the 1992 standards were prepared and provides examples of test exercises that illustrate the mathematics 
content reflected in the descriptions of the NAEP achievement levels. 



improve the form and use of the National Assessment” and to identify “appropriate achievement goals for 
each . . . grade and subject area to be tested in the National Assessment.” To carry out its responsibilities, 
NAGB developed achievement levels, which are collective judgments about how students should perform, 
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Reporting NAEP results on the basis of achievement levels represents a significant change in practice for 
NCES. On occasion, this agency makes use of emerging analytical approaches that permit new, and 
sometimes controversial, analyses to be done. Just as other statistical agencies do when introducing new 
measures to supplement or replace old measures, NCES has in this report provided the data according to 
the earlier procedures in addition to the new procedures. For this reason, in addition to NAEP results 
reported according to achievement levels, results according to the scale anchoring procedure that has been 
used since the 1984 assessment can be found in an appendix to this report. Presenting the data both ways 
gives the public — not just technical evaluators -- an opportunity to be informed, so that all data users will 
be able to assess for themselves how well the various forms of reporting and interpreting the data meet their 
needs. 



Technical Review of NCES Reports 



All reports published by NCES are evaluated through an adjudication procedure. This process represents 
a final quality control check designed to assure that all publications conform to statistical standards, are 
grounded in the data, and take into account relevant substantive research literature. The adjudication 
process also attempts to delete misleading interpretive statements, and provide text that is clear and 
understandable to the American public. During the adjudication of this report neither the process for setting 
achievement levels developed by ACT nor the scores representing each level was addressed. The process 
and the cutpoints were taken as a given. The issue of valid inferences was addressed however. A number 
of reviewers interpreted statements about what students should do at the various achievement levels 
according to the standards set by NAGB as statements about what students can do. Independent studies 
are being conducted concerning the appropriate inferences that can be drawn from the NAEP results 
reported by achievement levels. Early results from technical evaluations suggested that this apparently 
logical step in interpretation might not be justified after closer examination of the data about what students 
at these levels actually demonstrate in terms of mathematical competencies. Discussion about the 
achievement levels also raised questions about the need for validity evidence for the anchor levels, as well 
as for greater understanding of the underlying assumptions of the process by which they were 
developed. 1 

This issue led NCES to seek the advice of several technical committees and to convene a meeting of 
technical and policy experts. Members, staff, and contractors of the National Assessment Governing Board 
participated in this meeting. Altogether these activities provided a forum for discussion of various historical 
and proposed approaches to interpreting the NAEP scale. In order to better inform the public about these 
and other interpretation issues, a companion NCES report entitled Interpreting NAEP Scales (Washington, 
DC: National Center for Education Statistics, 1993) explains several approaches to reporting information 
from NAEP. 



i 



R.A. Forsyth. “Do NAEP Scales Yield Valid Criterion-referenced Interpretations?” 
10. (1991). pp. 3-9, 16. 
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Actual Student Performance 

Then the next question is: Through their performance on the NAEP items, what actual knowledge and 
abilities did students demonstrate? Chapters 1 - 7 of this report include information on overall means and 
on distributions of scores, all taken directly from the test item data. The Appendix addresses this question 
in the manner that NAEP has used since 1985, using anchor points. As implemented for this report, the 
scale anchoring process provides a concise summary of what students know and can do at various points 
along the scale that differentiates them from students performing at lower levels. First, students perfo rmin g 
at or around four intervals on the scale were identified (200, 250, 300, and 350 -- each of which is one 
standard deviation unit apart). Next, questions were identified that were answered correctly by 65 percent 
or more of the students at one level and by fewer than half of the students at the next lower level. Finally, 
mathematics educators were asked to analyze each anchor-level question and create summary descriptions 
of the knowledge and skills evidenced by students who answered these sets of questions successfully. The 
critical distinction here is that anchor levels attempt to describe what students can do at and around selected 
points on the NAEP scale; achievement levels attempt to describe what students should be able to do in 
various ranges of the NAEP scale. 

Future Work 



These achievement level standards are in the second round (the first being in 1990) in a developmental 
process which has been revised and is still under review through several studies. 2 The Board’s goal is to 
provide a statement of what American students should be able to do as a standard that can give more 
meaning to the NAEP data. They then want to use the NAEP data to inform the nation as to how many 
students actually can meet these standards. 

NCES realizes that modifications and improvements may be necessary in the future as current procedures 
are evaluated and new approaches are considered. NCES conceives of this process as a research and 
developmental activity in which numerous statistical, psychometric, and substantive issues must be resolved. 
At the present time the effort is hampered by the problem of trying to create standards on a given framework 
and item pool developed for another purpose. In the future the measurement of standards will be a more 
prominent influence on the development of NAEP procedures. 



1 Assessing Student Achievement in the States. The First Report of the National Academy of Education Panel on the Evaluation 
of the NAEP Trial State Assessment: 1990 Trial State Assessment. (Stanford, CA: National Academy of Education, 1992).; 
R.L. Linn, D.M. Koretz, E.L. Baker, and L. Burstein. The Validity and Credibility of the Achievement Levels for the 1990 National 
Assessment of Educational Progress in Mathematics, Technical Report CSE No. 330. (Los Angeles, CA: Center for Research on 
Evaluation, Standards, and Student Testing, UCLA, June, 1991). 
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The goal of the National Center for Education Statistics is to make data available for the public and to do 
so in accurate and understandable ways that are not misleading. In this case, much of what matters in 
NAEP is changing: 

• the content in response to the developing standards of various curricular groups; 

• the test items in response to new developments in assessments; and 

• the reporting in response to, and increasing interest in, student achievement relative to 
standards of student performance. 

We believe that the numerous completed and ongoing studies will lead to national debate that will assure 
the public is well informed about these issues — as informed they must be because the results will be a vital 
influence on what Americans come to think about the condition and progress of our schools. 

In addition, the public needs the data in this report to see for themselves what standards-based reporting 
might do and to evaluate the often conflicting claims of adherents and detractors of these changes in 
approaches to reporting on the educational achievement of American students. The Center eventually 
wants to use the achievement levels to describe what students know and can do. In order to accomplish 
that, the frameworks, tests, and achievement levels may need to be developed in tandem. That is easier to 
say than to do, however, because it implies a substantially larger pool of test exercises, carefully designed 
to support reporting about performance relative to a set of performance standards. Clearly this is a 
developmental effort that will take time and several iterations, during which data supporting appropriate 
inferences about the performance of American students will continue to be gathered. 
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In 1988, Congress passed new legislation for the National Assessment of Educational Progress (NAEP) that 
continued its primary mission of providing dependable and comprehensive information about educational 
progress in the United States. In addition, for the first time in the project’s history, the legislation also 
included a provision authorizing voluntary, state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State Assessment Program that 
assessed public-school students in 37 states, the District of Columbia, and two territories in eighth-grade 
mathematics. 3 The 1992 NAEP program included an expanded Trial State Assessment Program in fourth- 
and eighth-grade mathematics and fourth-grade reading, with public-school students assessed in 41 states, 
the District of Columbia, and two territories. In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program in 1990 and in 
1992. 

In Kentucky in 1992, 118 public schools participated in the fourth-grade mathematics assessment, and 104 
participated in the eighth-grade mathematics assessment. The weighted school participation rate was 
96 percent in fourth grade and 98 percent in eighth grade, which means that the fourth-grade students in 
this sample of schools were representative of 96 percent of all the fourth-grade public-school students in 
Kentucky, and the eighth-grade students in this sample of schools were representative of 98 percent of all 
the eighth-grade public-school students in Kentucky. 

In total, 2,703 fourth-grade and 2,756 eighth-grade Kentucky public-school students were assessed in 
mathematics. The weighted student participation rate was 96 percent in grade 4 and 96 percent in 
grade 8. This means that the sample of students who took part in the assessment was representative of 
96 percent and 96 percent of the eligible fourth-grade and eighth-grade public-school student populations 
in participating schools in Kentucky (that is, all students minus those excluded from the assessment). The 
overall weighted response rate (school rate times student rate) was 92 percent in fourth grade and 
94 percent in eighth grade. This means that the sample of students who participated in the assessment was 
representative of 92 percent and 94 percent of the eligible fourth- and eighth-grade public-school student 
populations in Kentucky, respectively. 

3 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State 
of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: 
National Center for Education Statistics, 1991). 
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Students’ Mathematics Performance 



Students’ performance in mathematics was summarized on the NAEP mathematics scale, which ranges 
from 0 to 500. 



Grade 4 
1992 



The average proficiency of public-school students from Kentucky on the NAEP 
mathematics scale was 214. This proficiency was lower than that of students across the 
nation (217). 4 The lowest performing 10 percent of the students from Kentucky had 
proficiencies below 176 while the top 10 percent of the students had proficiencies above 



Grade 8 | The average proficiency of public-school students from Kentucky on the NAEP 

1992 I mathematics scale was 261. This proficiency was lower than that of students across the 

nation (266). The lowest performing 10 percent of the students in Kentucky had 
proficiencies below 216 while the top 10 percent of the students had proficiencies above 
305. 



Grade 8 The average proficiency of public-school students in Kentucky in 1992 was higher than 
1990 vs 1992 1 the average proficiency in 1990 (261 in 1992 and 257 in 1990). In Kentucky, the score 
that signified the 10th percentile in 1992 (216) was about the same as the score that 
signified the 10th percentile in 1990 (216). Similarly, the score that signified the 90th 
percentile in 1992 (305) was about the same as the score that signified the 90th percentile 
in 1990 (300). 



LEVELS OF ACHIEVEMENT 



When Congress established the National Assessment Governing Board (NAGB) in 1988 to set policy for 
NAEP, it charged the board with “identifying appropriate achievement goals for each age and grade in each 
subject area to be tested under the National Assessment.” (Pub. L. 297-100 Section 3403 (a)(5)(B)(ii)). 



NAGB developed three achievement levels for each grade - Basic, Proficient, and Advanced. Performance 
at the Basic level denotes partial mastery of the knowledge and skills that are fundamental for proficient 
work at each grade level. The central level, called Proficient, represents solid academic performance at each 
grade level tested. Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Achievement at the Advanced level signifies superior 
performance at the grade tested. 



Grade 4 
1992 



About half of the students in public schools in Kentucky (53 percent), versus 59 percent 
in the nation, are at or above the Basic level. Some of the students in Kentucky 
(13 percent), versus 18 percent in the nation, are at or above the Proficient level. 
Relatively few of the students in Kentucky (1 percent), versus 2 percent in the nation, 
are at or above the Advanced level. 



Differences reported are statistically significant at the 95 percent confidence level. This means that with 95 percent confidence, 
there is a real difference in the average mathematics proficiency between the two populations of interest. “About the same” 
means that no statistically significant difference was found at the 95 percent confidence level. 
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Grade 8 
1992 






Grade 8 
1 990 vs 1992 



More than half of the public-school students in Kentucky (57 percent), versus 61 percent 
in the nation, are at or above the Basic level, while some of the students in Kentucky 
(17 percent), versus 23 percent in the nation, are at or above the Proficient level, and 
relatively few of the students in Kentucky (2 percent), versus 3 percent in the nation, are 
at or above the Advanced level. 

Compared to 1990, there was an increase in the percentage of students in Kentucky at 
or above the Basic level (57 percent in 1992 compared to 51 percent in 1990), no 
significant difference in the percentage of students at or above the Proficient level 
(17 percent in 1992 compared to 14 percent in 1990), and no significant difference in the 
percentage of students at or above the Advanced level (2 percent in 1992 compared to 
1 percent in 1990). 



CONTENT AREA PERFORMANCE 



The questions comprising the Trial State Assessment covered the content areas of Numbers and Operations; 
Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and Functions; as well as 
Estimation skills. Estimation was measured using a special paced audiotape that limited the amount of time 
students had to work on each question and made any direct calculations of answers difficult. The 
information from the Estimation section is intended to supplement the data obtained from the Numbers 
and Operations and the Measurement questions administered using the more traditional paper-and-pencil 
or calculator approaches. 

Students in Kentucky performed lower than students in the nation in Measurement and 
Geometry. 

Students in Kentucky performed lower than students in the nation in Measurement, 
Geometry, and Algebra and Functions. 

Estimation was not included in the 1990 Trial State Assessment program. Therefore, 
change in eighth-grade performance is provided only for the five content areas. There 
was an improvement in student performance from 1990 to 1992 in Kentucky in Numbers 
and Operations and Measurement. 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



Subpopulation Performance 



Many of the reforms recommended for mathematics education have emphasized the need to stress 
mathematics for all students. 5 Nevertheless, assessment results consistently show lower achievement for 
subpopulations of students who are less advantaged than their classmates. 6 The 1992 Trial State 
Assessment sheds further light on this by reporting on the performance of various subgroups of the student 
population defined by race/ethnicity, type of community, parents’ education level, and gender. 



5 Everybody Counts: A Report to the Nation on the Future of Mathematics Education , Lynn Steen, Ed. (Washington, DC: National 
Research Council, National Academy Press, 1989). 



6 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement. NAEP s 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 
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In Kentucky: 



RACE/ETHNICITY 



Grade 4 
1992 



Grade 8 
1992 | 



Grade 8 
1990 vs 1992 



White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. Some of the White students (14 percent), relatively few of the Black 
students (4 percent), and relatively few of the Hispanic students (4 percent) were at or 
above the Proficient level. 

White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. Some of the White students (18 percent), relatively few of the Black 
students (5 percent), and relatively few of the Hispanic students (5 percent) were at or 
above the Proficient level. 

The performance of White students was higher in 1992 than it was in 1990. The 
performance of Black and Hispanic students stayed about the same from 1990 to 1992. 
About the same percentage of White, Black, and Hispanic students were at or above the 
Proficient level in 1992 as in 1990. 



TYPE OF COMMUNITY 



Grade 4 
1992 



Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban 
areas, extreme rural areas, or areas classified as “other”. Less than half of the students 
attending schools in advantaged urban areas (33 percent), relatively few of the students 
in disadvantaged urban areas (9 percent), some of the students in extreme rural areas 
(12 percent), and some of the students in areas classified as “other” (12 percent) were 
at or above the Proficient level. 



Grade 8 
1992 



Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban 
areas, extreme rural areas, or areas classified as “other”. About half of the students 
attending schools in advantaged urban areas (45 percent), some of the students in 
disadvantaged urban areas (12 percent), some of the students in extreme rural areas 
(16 percent), and some of the students in areas classified as “other” (17 percent) were 
at or above the Proficient level. 



Grade 8 
1990 vs 1992 



The performance of students in advantaged urban areas and extreme rural areas was 
higher in 1992 than it was in 1990. Students in disadvantaged urban areas and areas 
classified as “other” performed about the same in 1992 as in 1990. About the same 
percentage of students in advantaged urban areas, disadvantaged urban areas, extreme 
rural areas, and areas classified as “other” were at or above the Proficient level in 1992 
as in 1990. 
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Grade 4 
1992 



Students who reported that at least one parent graduated from college demonstrated 
about the same average mathematics proficiency as did students who reported that at least 
one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 
Achievement was at or above the Proficient level for 21 percent of the students who 
reported that at least one parent graduated from college, 20 percent of the students who 
reported that at least one parent had some education after high school, 10 percent of the 
students who reported that at least one parent graduated from high school, 6 percent of 
the students who reported that neither parent graduated from high school, and 8 percent 
of the students who reported that they did not know their parents’ education level. 



Grade 8 
1992 



Students who reported that at least one parent graduated from college demonstrated 
higher mathematics proficiency than did students who reported that at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents education 
level. Achievement was at or above the Proficient level for 32 percent of the students 
who reported that at least one parent graduated from college, 20 percent of the students 
who reported that at least one parent had some education after high school, 9 percent 
of the students who reported that at least one parent graduated from high school, 
5 percent of the students who reported that neither parent graduated from high school, 
and 6 percent of the students who reported that they did not know their parents’ 
education level. 



Grade 8 
1990 vs 1992 



The performance of students who reported that at least one parent graduated from college 
was higher in 1992 than it was in 1990. Students who reported that at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level performed about the same in 1992 as in 1990. A greater percentage of students who 
reported that at least one parent graduated from college were at or above the Proficient 
level in 1992 than in 1990. About the same percentage of students who reported that at 
least one parent had some education after high school, at least one parent graduated from 
high school, neither parent graduated from high school, or they did not know their 
parents’ education level were at or above the Proficient level in 1992 as in 1990. 



GENDER 

In Kentucky, in both fourth grade and eighth grade, there appears to be no significant 
difference in the average mathematics proficiency of males and females attending public 
schools. There was no significant difference between the percentages of fourth-grade 
males and females who were at or above the Proficient level (12 percent for females and 
14 percent for males). In addition, there was no significant difference between the 
percentages of eighth-grade males and females who were at or above the Proficient level 
(16 percent for females and 18 percent for males). 

The average mathematics proficiency for eighth-grade females in 1992 was higher than the 
average mathematics proficiency for eighth-grade females in 1990. The average 
mathematics proficiency for eighth-grade males in 1992 was about the same as the average 
mathematics proficiency for eighth-grade males in 1990. Furthermore, about the same 
percentage of eighth-grade males were at or above the Proficient level in 1992 as in 1990. 
About the same percentage of eighth-grade females were at or above the Proficient level 
in 1992 as in 1990. 



Grade 8 
1990 vs 1992 



Grades 4 & 8 
1992 
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A Context for Understanding Students' Mathematics Proficiency 



The results of the Trial State Assessment can be used to monitor students’ progress in achieving the 
recommendations of the National Council of Teachers of Mathematics and to examine both school and 
home contexts for educational support. The public-school students participating in the 1992 Trial State 
Assessment, their mathematics teachers, and the principals or other administrators in their schools were 
asked to complete questionnaires on policies, instruction, and programs. These student, teacher, and school 
data help to describe some of the current practices and emphases in mathematics education, illuminate some 
of the factors that appear to be related to fourth- and/or eighth-grade public-school students’ proficiency in 
the subject, and provide an educational context for understanding data on student achievement. The data 
from the questionnaires also provide a means to examine changes in policies, instruction, and programs at 
the eighth-grade level between 1990 and 1992 for those states and territories that participated in both Trial 
State Assessment Programs. 



Highlights of the results for the public-school students in Kentucky are as follows: 



CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• According to their mathematics teachers, 81 percent of the fourth-grade students and 
47 percent of the eighth-grade students received four or more hours of mathematics 
instruction per week. 

• According to their mathematics’ teachers, the greatest percentage of fourth-grade students 
were assigned 15 minutes of mathematics homework each day, and the greatest percentage 
of eighth-grade students were assigned 30 minutes of mathematics homework each day. 

• According to the students in grade 8, average mathematics proficiency was higher for 
students in Kentucky who spent 30 minutes on mathematics homework than for students 
who spent no time on mathematics homework each day. 

• In Kentucky, 91 percent of the fourth-grade students had mathematics teachers who placed 
heavy instructional emphasis on Numbers and Operations, 21 percent had teachers who 
placed heavy instructional emphasis on Measurement, 9 percent had teachers who placed 
heavy instructional emphasis on Geometry, 1 1 percent had teachers who placed heavy 
instructional emphasis on Data Analysis, Statistics, and Probability, and 1 percent had 
teachers who placed heavy instructional emphasis on Algebra and Functions. 

• In Kentucky, 77 percent of the eighth-grade students had mathematics teachers who placed 
heavy instructional emphasis on Numbers and Operations, 20 percent had teachers who 
placed heavy instructional emphasis on Measurement, 22 percent had teachers who placed 
heavy instructional emphasis on Geometry, 15 percent had teachers who placed heavy 
instructional emphasis on Data Analysis, Statistics, and Probability, and 50 percent had 
teachers who placed heavy instructional emphasis on Algebra and Functions. 
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DELIVERY OF MATHEMATICS INSTRUCTION 

• According to the mathematics teachers in Kentucky, 74 percent of the fourth-grade students 
and 52 percent of the eighth-grade students worked mathematics problems in small groups 
at least weekly; relatively few in grade 4 and relatively few in grade 8 never or hardly ever 
worked mathematics problems in small groups (5 percent and 9 percent, respectively). 

• According to the students in Kentucky, 41 percent of the fourth-grade students and 
38 percent of the eighth-grade students worked mathematics problems in small groups at 
least weekly; 40 percent in grade 4 and 32 percent in grade 8 reported never or hardly ever 
working mathematics problems in small groups. 

• According to the mathematics teachers in Kentucky, 76 percent of the fourth-grade students 
and 80 percent of the eighth-grade students were assigned problems from a mathematics 
textbook almost every day; 2 percent and 3 percent in fourth and eighth grade, respectively, 
worked textbook problems less than weekly. 

• According to the students in Kentucky, 68 percent of the fourth-grade students and 
84 percent of the eighth-grade students were assigned problems from a mathematics 
textbook almost every day; 18 percent and 5 percent in fourth and eighth grade, 
respectively, worked textbook problems less than weekly. 



USE OF CALCULATORS 

• In Kentucky, 77 percent of eighth-grade students were in schools in which they were given 
access to four-function calculators and 35 percent were in schools in which they were given 
access to scientific calculators. Across the nation, these figures were 66 percent for 
four-function calculators and 37 percent for scientific calculators. In addition, in Kentucky, 
77 percent of eighth graders had mathematics teachers who reported providing instruction 
to students about the use of four-function calculators and 42 percent had teachers who 
reported providing instruction about scientific calculators. Nationally, these figures were 
64 percent and 37 percent of the eighth-grade students, respectively. 

• According to the students’ mathematics teachers, 47 percent of the fourth-grade students 
and 73 percent of the eighth-grade students used calculators at least once a week in 
mathematics class. By comparison, 16 percent and 9 percent in fourth and eighth grade, 
respectively, never or hardly ever used a calculator. In 1990, 31 percent of the eighth-grade 
students had mathematics teachers who reported that they used calculators at least once a 
week and 37 percent had mathematics teachers who reported that they never or hardly ever 
used calculators. 



EDUCATIONAL BACKGROUND OF TEACHERS 

• In Kentucky, 79 percent of the fourth-grade students and 65 percent of the eighth-grade 
students were being taught by mathematics teachers who reported having at least a master’s 
or education specialist’s degree. Across the nation, these figures were 47 percent and 
47 percent for fourth- and eighth-grade students, respectively. 

• In Kentucky, 2 percent of the fourth-grade and 36 percent of the eighth-grade 
public-school students were being taught mathematics by teachers who had an 
undergraduate major in mathematics. Across the nation, 5 percent of the fourth-grade 
students and 45 percent of the eighth-grade students had mathematics teachers with a major 
in mathematics. 
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HOME FACTORS 

• Grade 4 students in Kentucky who had all four types of reading materials (an encyclopedia, 
newspapers, magazines, and more than 25 books in the home) showed a higher mathematics 
proficiency than did students with zero to two types of materials. This is similar to the 
results for the grade 8 students in Kentucky, where students who had all four types of 
materials showed a higher mathematics proficiency than did students who had zero to two 
types. 

• Some of the fourth-grade public-school students in Kentucky (17 percent) watched one 
hour or less of television each day; 24 percent watched six hours or more. 

• Some of the eighth-grade public-school students in Kentucky (12 percent) watched one 
hour or less of television each day; 13 percent watched six hours or more. In 1990, 
10 percent watched one hour or less of television each day while 14 percent watched six 
hours or more. 



Comparisons of Overall Mathematics Proficiency in Kentucky with Other States 



The maps on the following pages provide a method for making appropriate comparisons of the average 
overall mathematics proficiency in Kentucky with that in the other states (including the District of 
Columbia) and territories that participated in the NAEP 1992 Trial State Assessment Program. The 
different shadings of the states on the map show whether the average overall proficiency in the other states 
was statistically different from or not statistically different from that in Kentucky (“Target State”). States 
with a dark-colored shading have a significantly higher average proficiency than does Kentucky. States with 
a light -colored shading have a significantly lower average proficiency than does Kentucky. States without 
shading are not significantly different from Kentucky. The significance tests are based on a Bonferroni 
procedure for multiple comparisons that holds the probability of erroneously declaring the means of any 
two states to be different, when they are not, to five percent across all possible comparisons. Separate maps 
are provided for the results for grade 4 and grade 8. 
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The 1992 Trial State Assessment 

Comparisons of Overall Mathematics Proficiency at Grade 8 
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THE NATION’S 



p^nnoT 




1992 EE~f 



OVERVIEW 



Trial State Aseeasment 



In 1988, Congress passed new legislation for the National Assessment of Educational Progress (NAEP) that 
continued its primary mission of providing dependable and comprehensive information about educational 
progress in the United States. In addition, for the first time in the project’s history, the legislation also 
included a provision authorizing voluntary, state-by-state assessments on a trial basis: 

The National Assessment shall develop a trial mathematics assessment survey instrument for the 
eighth grade and shall conduct a demonstration of the instrument in 1990 in States which wish to 
participate , with the purpose of determining whether such an assessment yields valid , reliable State 
representative data. (Section 406(i)(2)(C)(i) of the General Education Provisions Act , as 
amended by Pub. L. 100-297 (U.S.C. 1221e-l(i)(2)(c)(i))) 

The National Assessment shall conduct a trial mathematics assessment for the fourth and eighth 
grades in 1992 and, pursuant to subparagraph (6)(D), shall develop a trial reading assessment 
to be administered in 1992 for the fourth grade in States which wish to participate , with the 
purpose of determining whether such an assessment yields valid, reliable State representative data. 
(Section 406(i)(2)(C)(i) of the General Education Provisions Act, as amended by Pub. L. 
100-297 (U.S.C. 1221e-l(i)(2)(c)(ii))) 

As a result of the legislation, the 1990 NAEP program included a Trial State Assessment Program that 
assessed public-school students in 37 states, the District of Columbia, and two territories in eighth-grade 
mathematics. 7 The 1992 NAEP program included an expanded Trial State Assessment Program in fourth- 
and eighth-grade mathematics and fourth-grade reading, with public-school students assessed in 41 states, 
the District of Columbia, and two territories. In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program in 1990 and in 



7 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State 
of Mathematics Achievement: NAEP's 1990 Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: 
National Center for Education Statistics, 1991). 
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The 1992 Trial State Assessment Program was conducted in February 1992 with the following 44 
participants: 



Alabama 


Louisiana 


Ohio 


Arizona 


Maine 


Oklahoma 


Arkansas 


Maryland 


Pennsylvania 


California ; ; 


Massachusetts 


Rhode Island 


Colorado 


Michigan 


South Carolina 


/ Connecticut 


Minnesota 


Tennessee 


/ . j- ' *■; r* !/; ;• \ 


Mississippi 


Texas 


District of Columbia 


Missoni rf 


Utah 


y Florida 


Nebraska 


Virginia 


:4 ;• Georgia 


New Hampshire 


West Virginia ; 


■ '•iy: ' f yffV yHawaii ' y**?* 


■ : New Jersey 


Wisconsin 


J^y. y Idaho '; r y • 


' ^ • New Mexico 


Wyoming 


-Indiana y'&yiy-. %4'j 


New York 


V :, ,'IyJ Iowi 


North Carolina 


’• ■; Guam 




North Dakota 


Virgin Islands* 



* The Virgin Islands participated in the testing portion of the 1992 Trial State Assessment Program. However, in accordance with 
the legislation providing for participants to review and give permission for release of their results, the Virgin Islands chose not to 
release their results at grade 4 in the reports. 



States in bold type did not participate in the 1990 Trial State Assessment. Three states — Montana, Illinois, 
and Oregon — participated in the 1990 Trial State Assessment but not in the 1992 program. 



For the 1992 Trial State Assessment, approximately 2,500 students were assessed in each jurisdiction for 
each grade and subject area. The samples were carefully designed to represent the fourth- and eighth-grade 
public-school populations in each state or territory. Similar to the 1990 program, local school district 
personnel administered all assessment sessions, and the contractor’s staff monitored 50 percent of the 
sessions as part of the quality assurance program designed to ensure that the sessions were conducted 
uniformly. The results of the monitoring in 1990 and 1992 indicated a high degree of quality and uniformity 
across sessions. 

Both the 1990 and 1992 Trial State Assessments in mathematics were based on a set of objectives developed 
for the program and patterned after the consensus process described in Public Law 98-511, Section 405 (E), 
which authorized NAEP through June 30, 1988. Anticipating the 1988 legislation that authorized the Trial 
State Assessment, the National Science Foundation and the U.S. Department of Education issued a special 
grant to the Council of Chief State School Officers in mid- 1987 to develop the objectives. The objectives 
development process included careful attention to the standards developed by the National Council of 
Teachers of Mathematics, 8 the formal mathematics objectives of states and of a sampling of local districts, 
and the opinions of practitioners at the state and local levels as to what content should be assessed. 

8 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1989). 
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The objectives were reviewed extensively by mathematics educators, scholars, states’ mathematics 
supervisors, the National Center for Education Statistics (NCES), and the Assessment Policy Committee 
(APC), a panel advising on NAEP policy at that time. They were further refined by NAEP’s Item 
Development Panel, reviewed by the Task Force on State Comparisons, and resubmitted to NCES for peer 
review. Because the objectives needed to be coordinated across all grades for the national program, the final 
objectives provided specifications for the NAEP mathematics assessment at the fourth, eighth, and twelfth 
grades, rather than solely for the Trial State Assessment Program. An overview of the mathematics 
objectives is provided in the Procedural Appendix. 



This Report 



This is a computer-generated report that describes the mathematics performance of fourth- and eighth-grade 
public-school students in Kentucky, in the Southeast region, and across the nation. A separate report will 
describe the results of the fourth-grade reading assessment. This report consists of three sections: 



• The Overview provides background information about the Trial State Assessment and a 
profile of the fourth- and eighth-grade public-school students in Kentucky. 

• Part One describes the mathematics performance of the fourth- and eighth-grade 
public-school students in Kentucky, the Southeast region, and the nation. It also describes 
the change in eighth-grade performance for those jurisdictions that participated in both the 
1990 and 1992 Trial State Assessment Programs. 

• Part Two relates fourth- and eighth-grade students’ mathematics performance to contextual 
information about the mathematics policies and instruction in Kentucky, the Southeast 
region, and the nation. Part Two also compares the eighth-grade data for 1990 and 1992 
for those jurisdictions that participated in both Trial State Assessment Programs. 



In this report, results are provided for groups of students defined by shared characteristics — race/ethnicity, 
type of community, parents’ education level, and gender. Definitions of these subpopulations are presented 
below. The results for Kentucky are based on the representative sample of students who participated in the 
1992 Trial State Assessment Program. The results for the nation and the region of the country are based 
on the nationally and regionally representative samples of public-school students who were assessed in 
January through March as part of the 1992 national NAEP program. Using the regional and national 
results from the 1992 national NAEP program is necessary because the voluntary nature of the Trial State 
Assessment Program did not guarantee representative national or regional results from the aggregated data 
across states, since not every state participated in the program. Specific details on the samples and analysis 
procedures used in 1990 and 1992 can be found in the Technical Reports for the NAEP Trial State 
Assessment Program for each of the assessment years. 9 



9 Technical Report of NAEPs J990 Trial State Assessment Program. (Washington, DC: National Center for Education Statistics, 
1991).; Technical Report of the NAEP 1992 Trial State Assessment in Mathematics. (Washington, DC: National Center for 
Education Statistics, 1993). 
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RACE/ETHNICITY 

Results are presented for students of different racial/ethnie groups based on the students’ self- identification 
of their race/ethnicity according to the following mutually exclusive categories: White, Black, Hispanic, 
Asian (including Pacific Islander), and American Indian (including Alaskan Native). Based on criteria 
described in the Procedural Appendix, there must be at least 62 students in a particular subpopulation in 
order for the results for that subpopulation to be considered reliable. Thus, results for racial/ethnic groups 
with fewer than 62 students are not reported. However, the data for all students, regardless of whether their 
racial/ethnic group was reported separately, were included in computing overall results for Kentucky. In 
addition, change in eighth-grade performance from 1990 to 1992 is reported only for those racial/ethnic 
groups for which there were at least 62 students in both the 1990 and 1992 samples. 



TYPE OF COMMUNITY 

Results are provided for four mutually exclusive community types — advantaged urban, disadvantaged 
urban, extreme rural, and other -- as defined below: 

Advantaged Urban: Students in this group live in metropolitan statistical areas and attend 

schools where a high proportion of the students’ parents are in professional or managerial 
positions. 

Disadvantaged Urban: Students in this group live in metropolitan statistical areas and attend 
schools where a high proportion of the students’ parents are on welfare or are not regularly 
employed. 

Extreme Rural: Students in this group live outside metropolitan statistical areas, live in areas 
with a population below 10,000, and attend schools where many of the students’ parents are 
farmers or farm workers. 

Other: Students in this category attend schools in areas other than those defined as advantaged 
urban, disadvantaged urban, or extreme rural. 



The reporting of results by each type of community was also subject to a minimum student sample size of 
62. Change in eighth-grade performance is reported only for those types of communities for which there 
were at least 62 students in both the 1990 and 1992 samples. 



PARENTS’ EDUCATION LEVEL 

Students were asked to indicate the extent of schooling for each of their parents -- did not finish high school, 
graduated from high school, some education after high school, or graduated from college. The response 
indicating the higher level of education was selected for reporting. Reporting of results by parents’ 
education level was also subject to a minimum student sample size of 62, and change in eighth-grade 
performance is reported only for those levels of parents’ education for which there were at least 62 students 
in both the 1990 and 1992 samples. 
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GENDER 

Results are reported separately for males and females. 



REGION 

The United States has been divided into four regions: Northeast, Southeast, Central, and West. States 
included in each region are shown in Figure 1. All 50 states and the District of Columbia are listed, with 
the participants in the Trial State Assessment highlighted in boldface type. Territories were not assigned 
to a region. Further, the part of Virginia that is included in the Washington, DC, metropolitan statistical 
area is included in the Northeast region; the remainder of the state is included in the Southeast region. 
Because most of the students are in the Southeast region, regional comparisons for Virginia are to the 
Southeast. 



figure l | Regions of the Country 
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Guidelines for Analysis and Reporting 

This report describes the mathematics proficiency of fourth- and eighth-grade students attending public 
schools and compares the results for various groups of students within that population — for example, those 
who have certain demographic characteristics or who responded to a specific background question in a 
particular way. The report examines the results for individual groups and individual background questions. 
It does not include an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the proportions of students in these groups and their average proficiency are based on samples — 
rather than the entire population of fourth or eighth graders in public schools in the state or territory — the 
numbers reported are necessarily estimates . As such, they are subject to a measure of uncertainty, reflected 
in the standard error of the estimate. When the proportions or average proficiency of certain groups are 
compared, it is essential that the standard error be taken into account, rather than relying solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based on statistical tests 
that consider both the magnitude of the difference between the means or proportions and the standard errors 
of those statistics. 

The statistical tests determine whether the evidence — based on the data from the groups in the sample — 
is strong enough to conclude that the means or proportions are really different for those groups in the 
population . If the evidence is strong (i.e., the difference is statistically significant ), the report describes the 
group means or proportions as being different (e.g., one group performed higher than or lower than another 
group) — regardless of whether the sample means or sample proportions appear to be about the same or 
not. If the evidence is not sufficiently strong (i.e., the difference is not statistically significant), the means 
or proportions are described as being about the same — again, regardless of whether the sample means or 
sample proportions appear to be about the same or widely discrepant. The reader is cautioned to rely on 
the results of the statistical tests — rather than on the apparent magnitude of the difference between sample 
means or proportions — to determine whether those sample differences are likely to represent actual 
differences between the groups in the population. The statistical tests and Bonferroni procedure, which is 
used when more than two groups are being compared, are discussed in greater detail in the Procedural 
Appendix. 

In addition, some of the percentages reported in the text of the report are given quantitative descriptions. 
The descriptive phrases used and the rules used to select them are also described in the Procedural 
Appendix. 
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Finally, in several places in this report, results (mean proficiencies and proportions) are reported in the text 
for combined groups of students. For example, in the text, the percentage of students in the combined 
group taking either algebra or pre-algebra is given and compared to the percentage of students enrolled in 
eighth-grade mathematics. However, the tables that accompany that text report percentages and 
proficiencies separately for the three groups (algebra, pre-algebra, and eighth-grade mathematics). The 
combined-group percentages reported in the text and used in all statistical tests are based on unrounded 
estimates (i.e., estimates calculated to several decimal places) of the percentages in each group. The 
percentages shown in the tables are rounded to integers. Thus, percentages may not always add up to 100 
percent due to rounding. Also, the percentage for a combined group (reported in the text) may differ slightly 
from the sum of the separate percentages (presented in the tables) for each of the groups that were 
combined. Therefore, if statistical tests were to be conducted based on the rounded numbers in the tables, 
the results might not be consonant with the results of the statistical tests that are reported in the text (based 
on unrounded numbers). 



Profile of Kentucky 

FOURTH- AND EIGHTH-GRADE SCHOOL AND STUDENT CHARACTERISTICS 



Table 1 provides a profile of the demographic characteristics of the fourth- and eighth-grade public-school 
students in Kentucky, the Southeast region, and the nation. The profile is based on data collected from the 
students and schools participating in the 1992 NAEP mathematics assessments. 

SCHOOLS AND STUDENTS ASSESSED 

Table 2 summarizes participation data for Kentucky schools and students sampled for both the 1990 and 
1992 Trial State Assessment in mathematics. 10 In Kentucky, in 1992, 118 public schools participated in 
the fourth-grade assessment, and 104 participated in the eighth-grade assessment. These numbers include 
participating substitute schools that were selected for some of the nonparticipating schools from the original 
sample. The weighted school participation rate was 96 percent in fourth grade and 98 percent in eighth 
grade, which means that the fourth-grade students in this sample of schools were representative of 
96 percent of all the fourth-grade public-school students in Kentucky, and the eighth-grade students in this 
sample of schools were representative of 98 percent of all the eighth-grade public-school students in 
Kentucky. 



10 For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates for the 
Mathematics Assessment (Washington, DC: National Center for Education Statistics, 1992).; or see Appendix B of the 1992 
State Technical Report. 
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In each school, a random sample of students was selected to participate in the assessment. As estimated 
by the sample, 0 percent of the fourth-grade and 0 percent of the eighth-grade public-school populations 
were classified as Limited English Proficient (LEP), while 8 percent in fourth grade and 9 percent in eighth 
grade had an Individualized Education Plan (IEP). An IEP is a plan, written for a student who has been 
determined to be eligible for special education, that typically sets forth goals and objectives for the student 
and describes a program of activities and/or related services necessary to achieve the goals and objectives. 
Handicapped or disabled students may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment. To be excluded, a student had to 
be categorized as Limited English Proficient or had to have an Individualized Education Plan and (in either 
case) be judged incapable of participating in the assessment. The intent was to assess all selected students; 
therefore, all selected students who were capable of participating in the assessment should have been 
assessed. However, schools were allowed to exclude those students who, in the judgment of school staff, 
could not meaningfully participate. The NAEP guidelines for exclusion are intended to assure uniformity 
of exclusion criteria from school to school. Note that some LEP and IEP students were deemed eligible 
to participate and not excluded from the assessment. The students in Kentucky who were excluded from 
the assessment because they were categorized as LEP or had an IEP represented 3 percent and 5 percent 
of the population, respectively, in grades 4 and 8. 

In total, 2,703 fourth-grade and 2,756 eighth-grade Kentucky public-school students were assessed in 
mathematics. The weighted student participation rate was 96 percent in grade 4 and 96 percent in 
grade 8. This means that the sample of students who took part in the assessment was representative of 
96 percent and 96 percent of the eligible fourth-grade and eighth-grade public-school student populations 
in participating schools in Kentucky (that is, all students minus those excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 92 percent in fourth grade and 
94 percent in eighth grade. This means that the sample of students who participated in the assessment was 
representative of 92 percent and 94 percent of the eligible fourth- and eighth-grade public-school student 
populations in Kentucky, respectively. 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. The percentages for Race/Ethnicity may not add to 100 percent because some students categorized themselves as 
“Other.” 



ERIC 



MAEP TRIAL STATE ASSESSMENT 



35 



27 



Kentucky 



TOE NATION S 
REPORT 
CARD 



1982 

Trtol state 



TABLE 2 



rnp 



Profile of the Population Assessed in 
Kentucky 



Grade 4 


Grade 8 


1992 


1990 
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PUBLIC SCHOOL PARTICIPATION 



Weighted school participation rate before substitution 

Weighted school participation rate after substitution 

Number of schools originally sampled 

Number of schools not eligible 

Number of schools in original sample participating 
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Total number of participating schools 



PUBLIC-SCHOOL. STUDENT PARTICIPATION 



Weighted student participation rate after makeups 

Number of students selected to participate in the assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English Proficiency 

Percentage of students excluded from the assessment due to 
Limited English Proficiency 

Percentage of students who had an Individualized Education Plan 
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Individualized Education Plan status 

Number of students to be assessed 

Number of students assessed 

Overall weighted response rate 
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In Kentucky in one or more fourth-grade schools, an assessment was conducted, but either the wrong materials were sent to the 
school(s) or the materials were lost in shipping via the U.S. Postal Service. The school(s) were included in the counts of 
participating schools, both before and after substitution. However, in the weighted results, the school(s) are treated in the same 
manner as a nonparticipating school because no student responses were available for analysis and reporting. 
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How Proficient in Mathematics Are Fourth- 
and Eighth-Grade Students in Kentucky 
Public Schools? 



Both the 1990 and 1992 Trial State Assessments covered five mathematics content areas -- Numbers and 
Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. In addition, items measuring a sixth area — Estimation — were included in the 1992 Trial State 
Assessment. Estimation was covered in both the 1990 and 1992 national NAEP programs, but not the 1990 
Trial State Assessment. 

This part of the report contains two chapters that describe the mathematics proficiency of fourth- and 
eighth-grade public-school students in Kentucky. Chapter 1 compares the overall mathematics 
performance of the students in Kentucky to students in the Southeast region and the nation. It also presents 
students’ average proficiency separately for each mathematics content area. Chapter 2 summarizes students’ 
overall mathematics performance for subpopulations defined by race/ethnicity, type of community, parents’ 
education level, and gender, as well as their mathematics performance in the content areas. Both chapters 
also describe the change in performance of eighth-grade public-school students from 1990 to 1992 for those 
jurisdictions that participated in the Trial State Assessment in both years. 
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CHAPTER 1 

Students’ Mathematics Performance 



Students’ performance in mathematics was summarized on the NAEP mathematics scale, which ranges 
from 0 to 500. As shown in Table 3 A: 



Grade 4 
1992 



The average proficiency of public-school students from Kentucky on the NAEP 
mathematics scale was 214. This proficiency was lower than that of students across the 
nation (2 17). 11 



Grade 8 
1992 



The average proficiency of public-school students from Kentucky on the NAEP 
mathematics scale was 261. This proficiency was lower than that of students across the 
nation (266). 



Grade 8 
1990 vs 1992 



The average proficiency of public-school students in Kentucky in 1992 was higher than 
the average proficiency for 1990 (261 in 1992 and 257 in 1990). 
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TABLE 3A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency 



Grade 4 


Grade 8 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 



11 Differences reported are statistically significant at the 95 percent confidence level. This means that with 95 percent confidence, 
there is a real difference in the average mathematics proficiency between the two populations of interest. “About the same” 
means that no statistically significant difference was found at the 95 percent confidence level. 
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There was also a tremendous range in student performance within each grade as shown by the percentile 
distributions presented in Table 3B. 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



The lowest performing 10 percent of the students from Kentucky had proficiencies below 
176 while the top 10 percent of the students had proficiencies above 253. 

The lowest performing 10 percent of the students in Kentucky had proficiencies below 
216 while the top 10 percent of the students had proficiencies above 305. 

In Kentucky, the score that signified the 10th percentile in 1992 (216) was about the same 
as the score that signified the 10th percentile in 1990 (216). Similarly, the score that 
signified the 90th percentile in 1992 (305) was about the same as the score that signified 
the 90th percentile in 1990 (300). 
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Fourth- and Eighth-Grade Public Schools 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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LEVELS OF MATHEMATICS ACHIEVEMENT 



Average proficiency on the NAEP scale provides an overall depiction of students’ mathematics achievement; 
however, by itself, it does not describe what students know and are able to do in the subjects, nor does it 
evaluate student performance against a standard. This report next presents a set of results based on applying 
the National Assessment Governing Board’s standards to student performance on the mathematics scale. 

When Congress established the National Assessment Governing Board (NAGB) in 1988 to set policy for 
NAEP, it charged the board with “identifying appropriate achievement goals for each age and grade in each 
subject area to be tested under the National Assessment.” (Pub.L. 297-100, Section 3403 (a)(5)(B)(ii)). To 
carry out this responsibility, NAGB contracted with American College Testing (ACT) to undertake 
advisory and analytic functions that could assist the Board in forming its conclusions as to appropriate 
achievement levels to be used for evaluating the 1992 mathematics assessment results. Achievement levels 
are mappings of collective judgments about how students should perform onto the achievement scale. 12 
Boundary points were developed for three achievement levels for each grade — Basic, Proficient, and 
Advanced. Performance at the Basic level denotes partial mastery of the knowledge and skills that are 
fundamental for proficient work at each grade level. The central level, called Proficient, represents solid 
academic performance at each grade level tested. Students reaching this level demonstrate competency over 
challenging subject matter and are well prepared for the next level of schooling. Achievement at the 
Advanced level signifies superior performance at each of the grades tested. 

In previous NAEP reports, a procedure known as scale anchoring was used to interpret or provide meaning 
to the scores. 1 3 Anchor points are not based on judgments of how much students should know or be able 
to do, and they do not differ by grade level. Instead, scale anchoring provides empirical descriptions of the 
types of procedural knowledge, mathematical skills, and problem-solving abilities that students need to 
answer items correctly at that level. These descriptions are based on a close examination by mathematics 
experts of the characteristics of the mathematics items that best discriminate those students performing at 
or near each of the anchor points from those performing at the next lower level. Unlike the 
achievement-level approach, the scale-anchoring procedure leaves to the reader the judgment as to whether 
the achievement demonstrated was adequate in terms of what students should be able to do. Table SI in 
the Scale Anchoring Appendix of this report presents the percentages of students at or above each of the 
four anchor points (200, 250. 300, and 350 on the NAEP scale) for the total population and for selected 
population subgroups. A companion report, entitled Interpreting NAEP Scales , describes the development 
over the last two decades of various procedures for reporting NAEP data and explains the meaning and 
interpretation of the NAEP scales. 



12 The Achievement Levels Appendix briefly describes the process of gathering expert judgments about Basic, Proficient, and 
Advanced performance -- as defined by NAGB policy — on each mathematics item, combining the various judgments on the 
various items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these levels. 

13 The Scale Anchoring Appendix provides definitions of each of four anchor points (200, 250, 300, and 350 on the NAEP scale) 
and briefly describes the process of identifying jtems that discriminate among students performing at adjacent levels and 
generalizing about the skills exemplified by those iiems. 
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This report follows NAGB’s policy that achievement levels should be the primary and initial method of 
presenting the results of the 1992 Trial State Assessment. In this report, these achievement levels not only 
are applied to the 1992 data, showing the proportions of students that achieve the three achievement levels, 
they also are applied to data from the 1990 mathematics assessment, permitting a report on changes in 
percentages of students at or above each of the achievement levels. 14 



Definitions of the three levels of mathematics achievement are given in Figure 2. Table 4 provides the 
percentages of students at or above each of these achievement levels, as well as the percentage of students 
below the Basic level. 



Grade 4 About half of the students in public schools in Kentucky (53 percent), versus 59 percent 

1992 in the nation, are at or above the Basic level. Some of the students in Kentucky 

(13 percent), versus 18 percent in the nation, are at or above the Proficient level. 
Relatively few of the students in Kentucky (1 percent), versus 2 percent in the nation, 
are at or above the Advanced level. 



More than half of the public-school students in Kentucky (57 percent), versus 61 percent 
in the nation, are at or above the Basic level, while some of the students in Kentucky 
(17 percent), versus 23 percent in the nation, are at or above the Proficient level, and 
relatively few of the students in Kentucky (2 percent), versus 3 percent in the nation, are 
at or above the Advanced level. 

Grade 8 I Compared to 1990, there was an increase in the percentage of students in Kentucky at 

t990 vsl992 I or above the Basic level (57 percent in 1992 compared to 51 percent in 1990), no 

significant difference in the percentage of students at or above the Proficient level 
(17 percent in 1992 compared to 14 percent in 1990), and no significant difference in the 
percentage of students at or above the Advanced level (2 percent in 1992 compared 
1 percent in 1990). 



Grade 8 
1992 



14 The 1990 achievement levels used in this report reflect changes in the processes used to develop the original 1990 achievement 
levels. In consequence, the 1990 findings presented here differ from the results published earlier by NAGB in its report by Mary 
Lyn Bourque and Howard H. Garrison, entitled The Levels of Mathematics Achievement: Initial Performance Standards for the 
1990 NAEP Mathematics Assessment. (Washington, DC: National Assessment Governing Board, 1991). 
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GRADE 4 

NAEP content areas: (1) Numbers and Operations; (2) Measurement; (3) Geometry; (4) Data Analysis, 
Statistics, and Probability; (5) Algebra and Functions. (Note: At the fourth-grade level, algebra and 
functions are treated in informal and exploratory ways, often through the study of patterns.) 



Skills are cumulative across levels -- from Basic to Proficient to Advanced. 



Fourth-grade students performing at the Basic level should show some evidence of understanding 
^ i the mathematical concepts and procedures in the rive NAEP content areas. In relation to the NAEP 

= EE YEL ! 1 1 " scale, Basic-level achievement for fourth grade is defined by proficiency scores at or above 211. 

Specifically, fourth graders performing at the Basic level should be able to estimate and use basic facts to perform simple 
computations with whole numbers, show some understanding of fractions and decimals, and solve simple real-world problems in all 
NAEP content areas. Students at this level should be able to use - though not always accurately - four-function calculators, rulers, 
and geometric shapes. Their written responses are often minimal and presented without supporting information. 



; [ 

PROFICIENT 

m&Mtm 



Fourth-grade students performing at the Proficient level should consistently apply integrated 
procedural knowledge and conceptual understanding to problem solving in the five NAEP content 
areas. In relation to the NAEP scale, Proficient-level achievement for fourth grade is defined by 
proficiency scores at or above 248. 



Specifically, fourth graders performing at the Proficient level should be able to use whole numbers to estimate, compute, and 
determine whether results are reasonable. They should have a conceptual understanding of fractions and decimals; be able to solve 
real-world problems in all NAEP content areas; and use four-function calculators, rulers, and geometric shapes appropriately. 
Students at the Proficient level should employ problem-solving strategies such as identifying and using appropriate information. 
Their written solutions should be organized and presented both with supporting information and explanations of how they were 
achieved. 



Z <4 Fourth-grade students performing at the Advanced level should apply integrated procedural 
ADVANCED ; knowledge and conceptual understanding to complex and nonroutine real-world problem solving in 
j-jpj; ]f TV~BI ; r,ve NAEP content areas. In relation to the NAEP scale, Advanced-level achievement for fourth 
‘ grade is defined by proficiency scores at or above 280. 

Specifically, fourth graders performing at the Advanced level should be able to solve complex and nonroutine real-world problems 
in all NAEP content areas. They should display mastery in the use of four-function calculators, rulers, and geometric shapes. These 
students are expected to draw logical conclusions and justify answers and solution processes by explaining why, as well as how, they 
were achieved. They should go beyond the obvious in their interpretations and be able to communicate their thoughts clearly and 
concisely. 
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(continued) I 




Trial State Assessment 



llfMe • 




Refer to the rectangle below. (NOTE: Size reduced from original.) 



Percent Correct 


State 




Nation 


mill ■ 



Use your centimeter ruler to make the following measurement to the nearest centimeter. 
What is the length in centimeters of one of the longer sides of the rectangle? 

Answer: (8 centimeters) 



Grade 4 ProficienLLevd Example Item 1 i ' 1 - ,<V ; v k _ - 1 



Carol wanted to estimate the distance from A to D along the path shown on the map below. 
She correctly rounded each of the given distances to the nearest mile and then added them. 
Which of the following sums could be hers? 




A. 4 + 6 + 5 = 15 

B. 5 + 6 + 5 = 16 

*C. 5 + 6 + 6 = 17 

D. 5 + 7 + 6 = 18 



Percent Correct 


State 


iiiiiiisi 


Nation 





gi M 



jnjjj 



Itent 







If Q] represents the number of newspapers that Lee delivers each day, 

which of the following represents the total number of newspapers that Lee delivers in 5 days? 



AS +□ 



*B. 5 X [] 


Percent Correct 


n 

□ 

*1* 


State 


S:-4a { 2 . 2 ) vg| 


D.(D + D)x5 


Nation 


48 .(1,4) i| 
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GRADE 8 



NAEP content areas: (1) Numbers and Operations; (2) Measurement; (3) Geometry; (4) Data Analysis, 
Statistics, and Probability; (5) Algebra and Functions. 



Skills are cumulative across all levels -- from Basic to Proficient to Advanced. 



i i:;: k iv ^ ^ Eighth-grade students performing at the Basic level should exhibit evidence of conceptual and 

t «'|; procedural understanding in the five NAEP content areas. This level of performance signifies an 

Jj: v'/W understanding of arithmetic operations — including estimation - on whole numbers, decimals, 
if-r'i fractions, and percents. In relation to the NAEP scale, Basic-level achievement for eighth grade is 
defined by proficiency scores at or above 256. 

Eighth graders performing at the Basic level should complete problems correctly with the help of structural prompts such as 
diagrams, charts, and graphs. They should be able to solve problems in all NAEP content areas through the appropriate selection 
and use of strategies and technological tools, including calculators, computers, and geometric shapes. Students at this level should 
also be able to use fundamental algebraic and informal geometric concepts in problem solving. 

As they approach the Proficient level, these students should be able to determine which of available data are necessary and sufficient 
for correct solutions and use them in problem solving. However, eighth graders at the Basic level show limited skill in 
communicating mathematically. 



Eighth-grade students performing at the Proficient level should apply mathematical concepts and 
procedures consistently to complex problems in the five NAEP content areas. In relation to the 
; i LEVEL NAEP scale, Proficient-level achievement for eighth grade is defined by proficiency scores at or 

above 294. 

They should be able to conjecture, defend their ideas, and give supporting examples. They should understand the connections 
between fractions, percents, decimals, and other mathematical topics such as algebra and functions. Students at the Proficient level 
are expected to have a thorough understanding of Basic-level arithmetic operations - an understanding sufficient for problem 
solving in practical situations. 

Quantity and spatial relationships in problem solving and reasoning should be familiar to them, and they should be able to convey 
underlying reasoning skills beyond the level of arithmetic. They should be able to compare and contrast mathematical ideas and 
generate their own examples. These students should make inferences from data and graphs, apply properties of informal geometry, 
and accurately use the tools of technology. Students at this level should understand the process of gathering and organizing data 
and be able to calculate, evaluate, and communicate results within the domain of statistics and probability. 




Eighth-grade students at the Advanced level should be able to reach beyond the recognition, 
identification, and application of mathematical rules in order to generalize and synthesize concepts 
and principles in the five NAEP content areas. In relation to the NAEP scale, Advanced-level 
achievement for eighth grade Is defined by proficiency scores at or above 331 . 



They should be able to probe examples and counter-examples in order to shape generalizations from which they can develop models. 
Eighth graders performing at the Advanced level should use number sense and geometric awareness to consider the reasonableness 
of an answer. They are expected to use abstract thinking to create unique problem-solving techniques and explain the reasoning 
processes underlying their conclusions. 
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Grade 8 Basie-Level Example Item 


IlSlllfllll 


' • .. t:; ‘ ■ ;■ 1 





Which of the following is both a multiple of 3 and a multiple of 7? 



A. 7,007 

B. 8,192 
*C. 21,567 



V. 

E. 40,040 


Percent Correct 




Did you use the calculator on this question? 

Yes No 


State 






Nation 







Grade 8 Proficient-Level Example Item 





80 




70 


Number 


60 


of 


50 


Sit-ups 


40 




30 



• • 



J I I 1 L 



10 15 20 25 30 
Age in Years 

In the graph above, each dot shows the number of sit-ups and the corresponding age for one 
of 13 people. According to this graph, what is the median number of sit-ups for these 13 people? 

A. 15 

B. 20 

C. 45 
*D. 50 

E. 55 



Did you use the calculator on this question? 

Yes No 



Percent Correct 




State 


||20'(L7) 




Nation 


||-23 (i.4) ; 
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lltad^ Example Item 




A 


B 


2 


5 


4 


9 


6 


13 


8 


17 



14 



If the pattern shown in the table were continued, what number would appear in the box at the 
bottom of column B next to 14? 

A. 19 

B. 21 

C. 23 

D. 25 
*E. 29 



Percent Correct 


State 




Nation 





:V 



ERIC 



1 NAEP TRIAL STATE ASSESSMENT 



46 



39 



Kentucky 




Trial State Assessment 



TABLE 4 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 



Orade 4 


Orade 8 


1992 


109O o 


1992 



Achievement Level 



At or Above Advanced Level 



At or Above Proficient Level 



At or Above Basic Level 



Below Basic Level 



Kentucky 

Southeast 

Nation 

Kentucky 

Southeast 

Nation 

Kentucky 

Southeast 

Nation 

Kentucky 

Southeast 

Nation 



twenta^e ' 1,1 

1 j 0-5) 

p ift fAm 

2(0.3) 

«c. 5: 

18 ( 1 . 1 ) 

53 ( 1.5) 1 
59 ! 1.1) ‘ ' 



wmm 

‘ ^2 ( 2-5), _ 



04$! 

l 2 ( oa} | 

\ o:&)V : 

|| 19, ( 1 S); | 

V^4S : f3.b}\ ■ 

49,(|bl|S 
f !’52‘3jr3jO) » 



Percentage 

V 2(0.4) 

iV| : i3y:0-5) ; N j 

18-( 1-0} = 
>39 ( 1J2) 'v 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 



Clearly, many students in Kentucky fail to meet or exceed the achievement levels that prescribe what 
students should know and should be able to do. Educators and policymakers will need to look to many 
sources of information and opinion for explanations of these levels of performance. Among the possible 
explanations, several factors should not be overlooked. First, students may not be learning enough in 
school to reach the achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide of mediocrity that 
threatens our very future.” 15 In 1990, the President and the Governors committed the Nation to six goals 
for education, the third of which called for American students to “leave grades four, eight and twelve having 
demonstrated competency in challenging subject matter.” The political leaders of this Nation are dissatisfied 
with the performance of American students. These NAEP findings co nfir m that a great many American 
students are not yet performing at the high standards embodied in the achievement levels. 



National Commission on Excellence in Education, A Nation at Risk. (Washington, DC: U.S. Department of Education, 1983). 
In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades has been arrested, and we hav< 
begun the long climb back to reasonable standards.” (p. 1 in American Education: Making it Work. (Washington DC* U S 
Department of Education, 1988).) 
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Second, some students may not be reaching the higher achievement levels because schools may not be 
teaching the elements of mathematics that are included on the NAEP assessment, and because the 
assessment may not be covering some elements of mathematics included in the school curriculum. No 
assessment or test can cover all the different areas of mathematics that are taught in school. The content 
coverage of the NAEP mathematics assessment was set by a consensus approach. Teachers, curriculum 
specialists, subject matter specialists, local school administrators, parents, and members of the general public 
actively participated in deciding what are the most important elements of mathematics to be included in the 
assessment and for students to learn. 16 Since 1990, the content coverage of the NAEP mathematics 
assessment has been moving toward closer alignment with the curriculum and evaluation standards 
recommended by the National Council of Teachers of Mathematics (NCTM). 1 7 The 1992 assessment has 
a greater emphasis on geometry and algebra and functions and less emphasis on numbers and operations 
than assessments prior to 1990. Included among the items are some constructed-response problem-solving 
questions that assess higher-level thinking skills that multiple-choice question formats cannot normally 
measure. The 1994 assessment will be even more closely aligned with the NCTM standards. Other 
evidence from NAEP, presented later in this report, indicates that many schools and teachers have not yet 
begun to follow the approach to teaching mathematics recommended by NCTM. 

Third, the Basic, Proficient, and Advanced achievement levels reflect high performance standards for the 
1992 NAEP mathematics scale. The establishment of achievement levels depends on securing a set of 
informed judgments of expectations for student educational performance and on summarizing the individual 
ratings into collective judgments. These expectations reflect the Board’s policy definitions, which require 
that students at the central, Proficient level demonstrate “competency over challenging subject matter.” 
The resulting standards are rigorous. The higher any standard is set, the fewer students will be able to reach 
that standard. 

As measures of performance, both average proficiency scores and percentages of students who score above 
the critical achievement levels on the NAEP scale provide a valuable overall depiction of students’ 
mathematics achievement. In order to present a closer look at how well students know particular areas of 
mathematics, the next section presents student performance in five content areas and Estimation. 



16 NAEP Mathematics Consensus Project. Mathematics Framework for the 1992 National Assessment of Educational Progress. 
(Washington, DC: National Assessment Governing Board, 1992). 

17 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989). 
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CONTENT AREA PERFORMANCE 



As previously indicated, the questions comprising the Trial State Assessment covered the content areas of 
Numbers and Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra 
and Functions; as well as Estimation skills. Estimation was measured using a special paced audiotape that 
limited the amount of time students had to work on each question and made any direct calculations of 
answers difficult. The information from the Estimation section is intended to supplement the data obtained 
from the Numbers and Operations and the Measurement questions administered using the more traditional 
paper-and-pencil or calculator approaches. Table 5A (average proficiency) and Table 5B (percentile 
distribution) provide the Kentucky, Southeast, and national results for each area. 



Grade 4 
1992 



Students in Kentucky performed lower than students in the nation in Measurement and 
Geometry. 



Grade 8 
1992 



Students in Kentucky performed lower than students in the nation in Measurement, 
Geometry, and Algebra and Functions. 



Grade 8 j Estimation was not included in the 1990 Trial State Assessment program. Therefore, 

1990 ys 1992 ] change in eighth-grade performance is provided only for the five content areas. There 

was an improvement in student performance from 1990 to 1992 in Kentucky in Numbers 
and Operations and Measurement. 
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TABLE 5A 



Fourth-Grade and Eighth-Grade 
Public-School Content Area Performance 



Grade 4 


Grade 8 


1892 


1990 


1992 



Numbers and Operations 

Kentucky 


^'Proficiency 

' 2lf(i.2) V T: 


iiJJProflciency":" 

H'IS-261 VI: 


Proficiency 

1 266 ( 1.1) > 


Southeast 


•w t A4205 ( 2.0) - 7 


j:- 260 ( 2.8) ■ , ■ 


1 263 ( 1.2)-. 


Nation 


'If 214 ( 0.9) ■' 


•.•^'.266 ( $3)|![ 1 - 


'A 270 ( 0.9) >" - 


Measurement 




.. .254 ( 1.2) i 2 


ill 259 (1.3) 


Kentucky 


•. 2 :\ ' 218 ( 1 


Southeast 


. . 214 ( 2,1) 


. ■ 248 ( 2.9) • . 


253 ( 1.6) , 


Nation 


: . .,222 ( 0.9) 


, : j 258 ( 1.6) 


||| 264 ( 1.3) > 


Geometry 

Kentucky 


V -ilaisp 


;!-Tl253 ( 1 '3) fA i 


|||; 256 ( )l!l)f Wfifi- 


Southeast 


■ ' 212 ( 1.6) . ‘ 


251.., ( 2.8} ' , ’ 


! , ■ • ' 253 ( 1.3) 


Nation 


•J:T 220 ( 0.7) • •. fi 


,,,‘.259 (1.4) , ||| 


262 ( 1.0) ,, 'y ; j 


Data Analysis , Statistics, and Probability 


,, ,' & :• JR# 




‘e'e'f / ‘{ . t i;j‘ • ; ** {‘ !( 


Kentucky 


fi2i5 


258 ( 1 .3} 


v262 


Southeast 


A 1 , 210(2.2), Ai 


.^1=;253‘ ( 3.2). ; i -:H 




Nation 


f|1i 218 ( 1.0)'sA' ' ‘ 






Algebra and Functions 


• i t ‘‘, ' "1 




\\ 

calls' . v 


Kentucky 


;V^t2:("ii) 




‘ 260 (; 14)i :lf 


Southeast 


206 ‘(2.2),.. 


. 256 . ( 2.4) 


' 259 (»I1SII1 


Nation 


■,/216( 0.9} • 


if;; 260 (;);,g!||!i! 


11^266^,4)^.;^ 


Estimation Skills 






•:<;< ! V • - ‘ < ( : * <*‘ { 


Kentucky 




l|;|S|r,;266 (. 0.9} 


Southeast 


* v -lias ( 3.9) ; :, .• 


li t;,; 


'-i|.:?64r(-.2v^ ; ;;'.% 


Nation 


: ■t‘ 206 ( fa)!'? 




(269- ( 13). 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — Estimation was not included in the 1990 Trial State Assessment. 
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m 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Content Area 



Trial State Assessment 


5th 

Percentile 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


95th 

Percentile 









GRADE 4 1992 
lumbers and Operations 

Kentucky 

Southeast 

Nation 

Measurement 

Kentucky 

Southeast 

Nation 

Geometry 

Kentucky 

Southeast 

Nation 

Data Analysis, Statistics, 
and Probability 

Kentucky 

Southeast 

Nation 

Algebra and Functions 

Kentucky 

Southeast 

Nation 

Estimation Skills 
Kentucky 
Southeast 
Nation 



GRADE 8 1990 
Numbers and Operations 
Kentucky 
Southeast 
Nation 

Measurement 

Kentucky 

Southeast 

Nation 

Geometry 

Kentucky 

Southeast 

Nation 

Data Analysis, Statistics, 
and Probability 
Kentucky 
Southeast 
Nation 

Algebra and Functions 

Kentucky 

Southeast 

Nation 

Estimation Skills 

Kentucky 

Southeast 

Nation 
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TABLE 5B 
(continued) 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Content Area 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ~ Estimation was not included in the 1990 Trial State Assessment. 
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CHAPTER 2 

Mathematics Performance by Subpopulations 



Many of the reforms recommended for mathematics education have emphasized the need to stress 
mathematics for all students. 18 Nevertheless, assessment results consistently show lower achievement for 
subpopulations of students who are less advantaged than their classmates. 19 The 1992 Trial State 
Assessment sheds further light on this by reporting on the performance of various subgroups of the student 
population defined by race/ethnicity, type of community, parents’ education level, and gender. 



RACE/ETHNICITY 



The Trial State Assessment results can be compared according to racial/ethnic groups when the number of 
students in a racial/ethnic group was sufficient in size to be reliably reported (at least 62 students). 

Table 6A (average proficiency) and Table 6B (percentile distribution) present fourth-grade mathematics 
performance results for White, Black, and Hispanic students, and eighth -grade mathematics performance 
results for White, Black, and Hispanic students from Kentucky. 



In Kentucky: 



Grade 4 
1992 



Grade B 
1992 



Grade 8 
1990 vs 1992 



White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. 

White students demonstrated higher average mathematics proficiency than did Black or 
Hispanic students. 

The performance of White students was higher in 1992 than it was in 1990. The 
performance of Black and Hispanic students stayed about the same from 1990 to 1992. 



18 Everybody Counts: A Report to the Nation on the Future of Mathematics Education , Lynn Steen, Ed. (Washington, DC: 
National Research Council, National Academy Press, 1989). 

19 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. TJie State of Mathematics Achievement : NAEP's 1990 
Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 
1991). 
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TABLE 6A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Race/Ethnicity 



Grade 4 


Grade 8 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
ot the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 6B 



GRADE 4 1992 
White 

Kentucky 
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Nation 

Black 
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Nation 



GRADE 8 1990 
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Nation 

Black 

Kentucky 

Southeast 

Nation 

Hispanic 

Kentucky 
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Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Race/Ethnicity 
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TABLE 6B 
(continued) 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Race/Ethnicity 



Trial State Assessment 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 
students). 



Table 7 presents mathematics performance by achievement levels. For Kentucky: 



Grade 4 
1992 



Some of the White students (14 percent), relatively few of the Black students (4 percent), 
and relatively few of the Hispanic students (4 percent) were at or above the Proficient 
level. 



Grade 8 
1992 



Some of the White students (18 percent), relatively few of the Black students (5 percent), 
and relatively few of the Hispanic students (5 percent) were at or above the Proficient 
level. 



Grade 8 
1990 VS 1992 



About the same percentage of White, Black, and Hispanic students were at or above the 
Proficient level in 1992 as in 1990. 



56 

ERIC 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



Kentucky 



THE NATION’S 
REPORT 
CARD 




TABLE 7 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Race/Ethnicity 



Trial State Assessment 
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TABLE 7 
(continued) 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Race/Ethnicity 



Trial State Assessment 


Grade 4 


Grade 8 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. ! Interpret with caution ~ the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



TYPE OF COMMUNITY 



Table 8A (average proficiency) and Table 8B (percentile distribution) present the mathematics proficiency 
results for fourth-grade students attending public schools in advantaged urban areas, disadvantaged urban 
areas, extreme rural areas, and areas classified as “other” and for eighth-grade students attending public 
schools in advantaged urban areas, disadvantaged urban areas, extreme rural areas, and areas classified as 
“other”. (These are the “type of community” groups in Kentucky with student samples large enough to 
be reliably reported.) 



In Kentucky: 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban 
areas, extreme rural areas, or areas classified as “other”. 

Students attending schools in advantaged urban areas demonstrated higher average 
mathematics proficiency than did students attending schools in disadvantaged urban 
areas, extreme rural areas, or areas classified as “other”. 

The performance of students in advantaged urban areas and extreme rural areas was 
higher in 1992 than it was in 1990. Students in disadvantaged urban areas and areas 
classified as “other” performed about the same in 1992 as in 1990. 
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TABLE 8A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Type of Community 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



Table 9 presents mathematics performance by achievement levels. In Kentucky: 




Less than half of the students attending schools in advantaged urban areas (33 percent), 
relatively few of the students in disadvantaged urban areas (9 percent), some of the 
students in extreme rural areas (12 percent), and some of the students in areas classified 
as “other” (12 percent) were at or above the Proficient level. 

About half of the students attending schools in advantaged urban areas (45 percent), 
some of the students in disadvantaged urban areas (12 percent), some of the students in 
extreme rural areas (16 percent), and some of the students in areas classified as “other” 
(17 percent) were at or above the Proficient level. 

About the same percentage of students in advantaged urban areas, disadvantaged urban 
areas, extreme rural areas, and areas classified as “other” were at or above the Proficient 
level in 1992 as in 1990. 
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Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Type of Community 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 
students). 
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Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Type of Community 
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(continued on next page) 
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TABLE 9 
(continued) 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Type of Community 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. ! Interpret with caution - the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 



PARENTS’ EDUCATION LEVEL 



Previous NAEP findings have shown that students whose parents are better educated tend to have higher 
mathematics proficiency. Table 10A (average proficiency) and Table 10B (percentile distribution) show 
the mathematics proficiency results for fourth-grade public- school students who reported that at least one 
parent graduated from college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, and they did not know their parents’ 
education level; and for eighth-grade public-school students who reported that at least one parent graduated 
from college, at least one parent had some education after high school, at least one parent graduated from 
high school, neither parent graduated from high school, and they did not know their parents’ education 
level. (These are the groups with student samples large enough to be reliably reported.) In Kentucky: 

Grade 4 Students who reported that at least one parent graduated from college demonstrated 

1992 about the same average mathematics proficiency as did students who reported that at least 

one parent had some education after high school but higher mathematics proficiency than 
did students who reported that at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ education level. 
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3 | Students who reported that at least one parent graduated from college demonstrated 

1992 I higher mathematics proficiency than did students who reported that at least one parent 

had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level. 

The performance of students who reported that at least one parent graduated from college 
was higher in 1992 than it was in 1990. Students who reported that at least one parent 
had some education after high school, at least one parent graduated from high school, 
neither parent graduated from high school, or they did not know their parents’ education 
level performed about the same in 1992 as in 1990. 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 




NAEP TRIAL STATE ASSESSMENT 



63 



57 



Kentucky 



THE NATION’S 
REPORT 
CARD 




TABLE 10B 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Parents’ Education 



Trial State Assessment 


5th 


10th 


25th 


50th 


75th 


90th 


95th 




Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 4 1992 
College graduate 



Kentucky 




' '173 (422) ' 


I#62 (12.4} 


iiiM’i'i®)':! 


• : C‘223't : ^j!!I 


243 ( 2.6) III 


r;;263 { 2.5) ■ 


; a.274 ( 4.6) 


Southeast 




sal 1 55 (: 3.1,) &5 


168 . ( 4.5) !(. 


iffiiii ( 4.6) 


216 { 3X1) v 


“,238 ( 2.8) i 


«' 259.(.:3.6),; : 


iii;iip27b ( 2.2 / 


Nation 






|gj||t 2:8) ; 




|!; ! l227 llll;:;; 


“.248 ( i.4)‘ 7;: 


<r ‘ 266 i 


::f 4 !:;S76 ( 2.3); • 


Some college 








‘ IN c * ‘r 


< • : «'* ,./•< 


- \j::; ./ji 




C; ;..•• l-E;:.; 


Kentucky 




. ,170 


ifl 


|;!;203;(3;9):i! 


:CH-222 (.4.2) J 


\; 243 (.3,4) ‘ j 


259 ( ,24) : : 


;|l268'i(-4,orV 


Southeast 




' 158(15,0) “ 




Sl%i$p;6R 


r-218 t ('2.4) 


:;:,'2^) : (104): i: 


!^60 (17.3) 1 


i;:;S270i(.7'5>:C- 


Nation 




M63 ( 


II 179 ( 1.5): 


WMZ&SM 


« ;'227 ( :j 17) 7 


i ;245 ( 2.4); 


‘ 259C3.2) J 


1 268 ( |||)|j 


High school graduate 




** * ,* c c ** i 


% illjj 1 ijjjjjs ?s|j‘!|!|;lj^ 


f- 5 * 




cCfVV: /< j- 


oipv. 1 


'(«’ “ ' \”7 


Kentucky 




•182 ( 4.0) ‘ • 


■ 172 (‘si) l 


kjqq ( mm 




■ : 229 ( { 2.l) 




l:!:2M:( : '2:2)7 


Southeast 




£152.( 6.4) 2 


, i63;( 3Vi)i 


: ;; ;i : 81i®6.2) 




•C:i225 ( ‘34ii:: :: : 


,-241 { 5,3) 


250 ( 3.2) ' 


Nation 




:;JtfS9;'(,;2:3) 


172 ( 3.4). | 


illllSii 






• v 251 ( 32) 


i 262 ( 4.1);?, 


High school non-graduate 








;; 4 






. c • . S 


; -’i / ' v ,v ‘ ( 


Kentucky 




B& ( 3.8)1 


ip69 mm 


!i:4.83 "( 3.3) I 


203 ( 3:9) 


il®2;(:l:|pH 


239 |®j 


251 pSpC 


Southeast 




* .149 ( 5.0) 'E 


•fi|158 ( 3.7)C 


7.175(10.1) 


-•c:200.(:4.6) c: 


;; : 2i6;(i : o;8)'C 


238 (14.6) 


||247= : (:i|7v2) : 


Nation 




154 ( 5.5) : 


mi&{ 5 : p) . 


• : :,183( $. : 2): 


204 ( 5.7) 


?:i!223;:(4:l) 1= 




;p|249-(;i4:8) 


1 don’t know 








, '« ;v. •/ |s| 










Kentucky 




1 65 ( 5.3) E: 




#192 ( T.3) 1 


i| j ‘210 ( 1.5)!^ 


228 (14) 


V 245= { b.Q j-i: 1 


2^ ( 2.5) : 


Southeast 




:i55 ( 3:5 ) . : 


:C185.( 3.4); : :C 


•/:fl85 ( 2)3) 


!i £ =;;,K)5{ 1.7)> { 


iE"225 ( .14) 


;l;i:-;243-( 4.0)3 


i : |i!li52.(4=7:):C; : 


Nation 




•^59 ( 


171 { i;5) : 


g|f9i j l$| 


‘:: { 213 1 ( i.5), c 


||234 ( 13) 




.< ‘261 ( 0.9) ; :U 


















GRADE 8 1990 




« V: 


: lijipillfil 


y 




' :|ci . ! ' |:{ij 






College graduate 






: • : •<> 


1 •*- ‘y «.• 




i ,b . lllijH ..'V; .... | j 


' i;. t *' , t 


•i- 't 'i'. C ;C’ : ‘ 


Kentucky 




f;210;(5”5)li;: 


* 224 ( 5.3} V 


1 247 ( ill 




MM I2' 3) 


'310(2.7) ; 


•II 322 .( 2.3) S 


Southeast 




•;204 (.6:4) > 


• ■•218.(33) ' 




c:^76 r { 3i4),.;i 


;S299 ( 6.6) • 


317- ( 4.8)' ! 


J- 329 ( 3.2) m 


Nation 




; 211 ( 6.2) :: 


C: ;226;( 2.4) | 


:. 252 j[ 1.3)3 


mmmM 




mmm 


|f329.(;:i-7);'- 


Some college 




,:V: ; V*. *;! 


vy.“ 






|I :||||sll • r|?«; lsl& 


' / < * 1 x c -i 




Kentucky 




•220 (.3^0ji- : 


I 230 ( : 5;lf S 


f -249 if ilm 


C:S^68 :; (iS) “ 


#291 ( 3.6) 2 


r : 5&)9 ( ifi) 1 


II;i32d‘-(- 6.2) 


Southeast 




. :205:.(i9.4) 


:.,-220::(;3.3)Hl 


7- 241 ( ; 3.5)1 


,263/(4.5) 


1285 (,6.7 ) 1 


JE300 ( 8.9)' :: : 




Nation 




;; 208 (5.9) . 


... 222 ( 8.4g! 


&S245 ( 1 .9) { 


C|; 268 ( 1.9) 


1289 ( 2,2) 1 


Ex305( ; =|^) ; ; 


^3M:(:;4.9)i; 


High school graduate 




11III11I 111! 


/,/ 




,, ' C ’.;V 


illllipi ."U"'kc: ' y<' y M 






Kentucky 




E205:.( 2:3);,S: 


217,:( : 1.5) 


233 ( 14) 


i:>253p*;5pf 


)”273 


-;;‘29i : ( : ;2.a) -i 


i.3b4 ; :(- ; 3Jl)/l 


Southeast 




f 189 (9.7) -I 


201.: (5.6) 


i;ii222 :(:;-7^0) .;! 


't&AT (.=5.2):- 


: =;i270 ( 6.7) c 


Si::289 7.1). -If 


Cft301iUil1.B) 


Nation 




i^ : ’(:M i:i 


212 ( 34); 




,/= 255 ( 13)1; 


v; 277; : ( 3^6) 


WMm^d 


^;||1:8) 


High school non-graduate 








jf| ! illl j i|| jf 




. ! . f ‘ ’ 




' ‘ : : • ;. •. 


Kentucky 




190 2) 


202 ( 4.5)ii, 


1 -219 (.3.4) s : 




260 (, : :i:6) 


280 ( 5.7)' C 


C= : ='291 ( 8.3) •;• 


Southeast 






. 204 ( 


ii22i ( 4:6)1 


1 r t 237!(-'3.8) c : . 


, 257 < 1.7) J: 


:fS69(3.1) ! 


278 :< i0.2); : 


Nation 




Cl 92 ( 9.2) E 


'.j2Q4j;|| %Mm 


11223 ( 


: ; ;;:;"242|( : 4.0) £ 


261 ( 3.9)11 


= ‘.277 ( 3.0) 


290(4.5) : 


1 don’t know 




'' 'C\; jif 


: ‘ 


^MUSBKK 


HAKH < '■ 


{ * l\ * j 


■y , : , , « \ { 


••• : J.i ;.;;Cv ‘C;’- ^ : 


Kentucky 




1 97 ( *7,6) $ 


‘ 204^:34):! 


3 ; 221 «? 


rt i24lH4):> 


\[2B0Xih) C 


' 281 ( 8.6) 


-295,(20.3) 


Southeast 




;17Sb<.&3).:.j; 


(154?! 


i!:l2iil:!l(!54)i:l 




ft!255:( a$)M 


276 (11,7) 


;'.290:( pJ),C 


Nation 




•Sl$2 ( 9.5) i- l 


• : £i9if ; fe.e)f!: 


!:!:fi2i5=pl2)r!:- 


S:24P : :( :: 3;2jia 


C265 (“ 4 . 0 ) . 


287 (10.0) r 


•298 (14.1) : 



(continued on next page) 
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(continued) 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Parents’ Education 



Trial State Assessment 


5th 


10th 


25th 


50th 


75th 


90th 


95th 




Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



GRADE 8 1992 
College graduate 

Kentucky 

Southeast 

Nation 

Some college 

Kentucky 

Southeast 

Nation 

High school graduate 

Kentucky 

Southeast 

Nation 

High school non-graduate 

Kentucky 

Southeast 

Nation 

I don’t know 

Kentucky 

Southeast 

Nation 



1 221 f 

lillllll 


: 

43): 1 
i\230 ; ! 2,4) ! 


"C255:f1,$) j 
mm% &9>:£ 

, 254 ( 2,7) | 


Smm&m 

II 281 1:23) ; :;;: 


*..302 

li;l295!:*iM).:C 

( i305|( 2,4) | 


= 322 ( t U) '■>' 
- •313 ( 3.4) .• 


5;-332i ■{ Far,e)H- 
S324'f?2-9): :: t 

33411,7)': 

' !‘“ •(»* 5 • • .1 l 


SaSoS pBp! 

plbe 

“213 j( M , 


‘220’{.4.1)‘ i 
;( 2,0) ; j 


245 f4.5) *! 
240i'5,ip. 


I .264 ( 2.1) ; t 

|||b9:;(«24)V, 


i:\M9 ( -2.8) ‘j 
#:.285;( 2.8f 


■' s *307: f 2.7) IS! 
„ 309 ( 2.9) M 

:. 5; 314.( : l)7) : ;g; 


iii7:|'3.3)v 

4.2 HS 


S:ao2 

mm ( mm 

;;20Q < 5,2) J 


207;( 7S)m 
, 212,(2,6) ,! 


233 ( ttgl 
1^42(4)1! 

;;23?|:|1,2): 


lliiliiiil 

j;ff247;C^) '] 
C,:'257 {{ ( 1^5) 'J 


lll76 E ( 2,1) ‘ i 
^C27i;fl0)'f: 
280 j 1,7)‘, 


« 29$ { 2.1)*,*] 
; 296 ( 2.0)||| 


: 303 < t.$) 1 
305 ( 4.0)1 

||3|o|i : ?;|g| 


'197-i 2^1 
202 ( 2.1 ) : : 
i 199 


(:!208 sYiy i] 

11208 ('7.5) 

£2.4) f 


mist 2.3), j 
6:225 : :f4.B) 
:,226 ( d.5) t “• 


1 246 (‘‘2.8) ;7 
&:?l;244 (:l7i2) . •■ 

1,1:245(3*6) 


266 ( 2.5) “ 
J ‘268 (4.9);v; 
||270.|2.2).;5 


282 ( 2.8 j -SR 
!: 266 f ( 8.8) 

{ *3:3) 


F293 (10.6)1;' 
297 < 9.7) : 
302 ( 5.1) J 


2 

TOf ! f:5;2)”y! 

-193 ( 3,0) . £ 


®i99(s;£^;! 

• :: '202 : (12^;3! 

!i : :=200f3,6)-: : -: 


« #17 ( 3,4),- p 
:C223 :! f#9)ifi 
vWiSW' 


ifiSKlii)!! 

?;247'(5.6) ; 5 
,249/3.3) 


i£2^-(. : 3.9)S 

:i27Zi$:6m 

• V 274 { 4,1 ) V 


• 294 (.6,1) 

R 296 ( •3;1)>S:- 


298 (19.9) 
!:;304;L 6.1)1: 
.-307 ( 5.5) 



The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > ( < ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 



Table 1 1 presents mathematics proficiency by achievement levels. In Kentucky: 



Grade 4 
1992 



Grade 8 
1992 



Grade 8 
1990 vs 1992 



Achievement was at or above the Proficient level for 21 percent of the students who 
reported that at least one parent graduated from college, 20 percent of the students who 
reported that at least one parent had some education after high school, 10 percent of the 
students who reported that at least one parent graduated from high school, 6 percent of 
the students who reported that neither parent graduated from high school, and 8 percent 
of the students who reported that they did not know their parents’ education level. 

Achievement was at or above the Proficient level for 32 percent of the students who 
reported that at least one parent graduated from college, 20 percent of the students who 
reported that at least one parent had some education after high school, 9 percent of the 
students who reported that at least one parent graduated from high school, 5 percent of 
the students who reported that neither parent graduated from high school, and 6 percent 
of the students who reported that they did not know their parents’ education level. 

A greater percentage of students who reported that at least one parent graduated from 
college were at or above the Proficient level in 1992 than in 1990. About the same 
percentage of students who reported that at least one parent had some education after 
high school, at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level were at or above 
the Proficient level in 1992 as in 1990. 
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TABLE 1 1 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Parents’ Education 



Trial State Assessment 


Grade 4 


Grade 8 


1992 


1990 


1992 








At or Above Advanced Level 


SlfepWcwtage ||| 


^^eircerrtage-“;. s 4; 


P^c^itage 


Kentucky 




v : s • 


s ; .. •• .. .■ • v a 


Graduated college 




P |!! ii ::!-‘3‘(‘0.8}:-.'‘< Si 


|lf! ( 0.9) •'.••• 


Some education after high school 




( 0:8)' '* ’ * 


■ : : : .ii ( 07) ; ' ; ; ; 


Graduated high school 


•Itf.M).- • “ • 




::":..0 ( 05) 


Did not finish high school 




WE!:b^;:q:2) = 


’ 0(0.1) 1 


1 don’t know 




1/( 1.1) • 


Pil • ■ I.;w,0) 


Southeast 


I- 'i f 


• >• : t V, *{ * s’"' 1 ' ‘ ! ■ 


V : \l §•!?!£! ; • 


Graduated college 


illllilif 0.7). .;:i, v 




/% 


Some education after high school 


, Or, 


VjjVtr 


o^) • £k- 


Graduated high school 


( o'.o> • ' 


i-w* -li: 


!«w; i(o.5) gi| 


Did not finish high school 


Sys-vJi kij-off 


*o ( o.o} i 5 '; 


feg*! 0 ( 


1 don’t know 


-V.'- 0 OS)" 1 . 


o (ja.o> ; i;; • 


0 ( : p)?<;vg:;; : 


Nation 




-1 ? \\ «V ' a 


: ! . . <: s'* 


Graduated college 




’ if; K 4 ( r o.9) ‘ * : 




Some education after high school 




( 0.9) MM 


iiaifg 


Graduated high school 




ilia® 




Did not finish high school 


o ( ( 


£V : V ; :: S ‘0 ( 0.1) •• '« . 


^ ii i (o.5) hJte 


1 don’t know 


i ( o.3):at||| 


S|l||| lilllll : 


g&) : e « 


At or Above Proficient Level 




' . 




Kentucky 








Graduated college 


0), ip 


I t 23 ( 2.‘1) "li 


!l|| i-;;-32 


Some education after high school 


( 35} / • 


22 ( : 2.S) V 'kr! 


; 20 ( 2:3) 


Graduated high school 






air 


Did not finish high school 






1-4) * f‘ 


1 don’t know 




iv <r< S{ 1J8> 'r A cl 


#lfll:i:6:i( 2.0) .*.■ ■ 'U 


Southeast 






'• :1i. V ' . .. *:*1 * 


Graduated college 




j ; 'i:;:';,i'30;( 4.5}' : ii'f’ 


• ’«■ 26 ( 22};.. - - 


Some education after high school 


f 3|5V 17 ( 5.3}' ■; 


,P\: 16 ( 3.4) - 


,. r ‘ 19 ( 1.8). , 


Graduated high school 




■ 7(2.4) 


iSiK s mtaw 


Did not finish high school 


v • ( 27} 


jjias;; 2 : ( i.6g:la 


6 ( 3.o) • 


1 don’t know 


( o.s) • " 


Hr? ’4 ( 2.2} 1 


111 ’9(3.0) ;■ 


Nation 


A ‘ — ' f : * 'f.'K •:* 




1-x • ■■ . « 


Graduated college 


l--' ” 25 f ( 2.6} 


3O : 0JofSm 


Ii 36(1.9) H 


Some education after high school 


■■ & (2.5) ■*' 


K S -20 ( 2.6) 1 • ‘ 


( i.5)v-:V. :: 


Graduated high school 


12 ( '15}- • 


i , t 12< 1.4) 5 ‘ 


( 1.3) : : f- : : 


Did not finish high school 


d;k '£( i-e> 


\ ; h, 4|[i .4) r |«4 


•“‘-."v 8 ( 1J8) 


1 don’t know 


,-,12 ( 1.1}-' 


\ ' \ 7 ( 2 -1) ‘ ) t \ 


}*?- 11 ( 1.9} / 


At or Above Basic Level 


‘ • i 




;t ; .• "/ rdf •;••••■• ' t ,v '‘ 


Kentucky 




c ; , { < i l ‘ •' ‘ « 




Graduated college 


Tr- 54 ( 27)., 


v' -, 65(2.4) .;> 


;) t :y/.' ; 74 ( i.6> > 


Some education after high school 


?S ? !S*&P(h3.9) 


." '66 ( 2.4). -k, : 


68(2.2) 


Graduated high school 


! ‘4$ ( 25) • •- 


* : * _ ! !S -:'46 ( 2.2) • 


$0 (2.5) 


Did not finish high school 


38 ( 3.9)'. 


,30 ( 25) v •’ 


lilftiiil 38 (2.7) 


1 don’t know 


48 ( 1.9) f.V. 


' S;®; 29'( 4.5) r 


34 ( 4.5) 


Southeast 


-■ ■ '.>?•; * * ‘‘j |, t 


f; " '' 


‘ ‘ ‘ ‘ 


Graduated college 


( 3.1)' ’■ ■ , ' 


: ' " 68 ( 3-5) , • 


.. ”;’67 ( 2.9)’ 


Some education after high school 


■"f.V-'" s ».( 6.1) . 


t};i-'59( 57}'; 


W% 61 ( 3.1) "'if • ••■' 


Graduated high school 


‘ if <’^(-145). V •• 


" v «-“:38i( 57} 


!!«;• 42 ( 2.2} 


Did not finish high school 


< 75), ' 


v; s M^s.ij 65) • 




1 don’t know 


2) . . : 


.54(7.3).' • 


■ : :«40(6.i) !f 


Nation 


llli . : .• m . 






Graduated college 


.66 ('14) • < 




. •74(1.4) •" 


Some education after high school 


68 ( 3.3) ' “ 




M Nil 67 ( 1.9) 


Graduated high school 


■:'pil54.(;:2.8) 


■ 49 ( 2.1):. v « 


^ jl £ : 5i,( : 2.2) 


Did not finish high school 


■ i 40 ( 5.2) ' ' 


32 ( 3.8) 


39 (3.3) ’ r 


1 don’t know 


- '52 ( 15) 


V: ; ,v 34 ( 3.7)- 


: -=' ; :-'o :; :43:(-2.5) 
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TABLE 11 
(continued) 



Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Parents’ Education 



Grade 4 


Grade 8 


1992 


1990 


1992 



Below Basic Level 




Percentage 


|p||flP!erceritage 


Percentage^:;! 


Kentucky 




■ «‘‘‘ 1 «‘ ‘ 1 ‘,s * ' '• ' 7 < \ 


||l| « ' ' - 






Graduated college 


38(2.7} 




WKi < 




Some education after high school 










Graduated high school 


,52(2:$) , 


(BMSPiPM 


‘SZ • 50 <sa 




Did not finish high school 






:■ 625(Sii3!pfc.!lc 




1 don’t know 


(liifcpiiil 


1 |||1 




Southeast 








‘ 'U ji 1 ' j *1, 




Graduated college 


‘ < ! 44(3.1) " 


‘ ’ 32 1 3.8} ' 






Some education after high school 






i : ; < 3L1)V<.“' 




Graduated high school 










Did not finish high school 


' ,66(7.8) ;;j 




63 ( 7-3) i 




1 don’t know 


‘ , f ,|«; , i“58 ( 2.2) « 






Nation 






*.« ! $ 1 < V $u t fM { 






Graduated college 






=. is (3S^i!i|:!! j WE 




Some education after high school 










Graduated high school 




V (,2.1): i ^ 






Did not finish high school 


. H.; m ( 5.2) 




* 6iilSijliilliiSii 




1 don’t know 


48 ( 1.5) 


68 (lii)lii| 





The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 
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Kentucky 



GENDER 



Table 12A (average proficiency) and Table 12B (percentile distribution) provide the mathematics 
proficiency results by gender. 

• In Kentucky, in both fourth grade and eighth grade, there appears to be no significant 
difference in the average mathematics proficiency of males and females attending public 
schools. 

• In Kentucky, the average mathematics proficiency for eighth-grade females in 1992 was 
higher than the average mathematics proficiency for eighth-grade females in 1990. The 
average mathematics proficiency for eighth-grade males in 1992 was about the same as the 
average mathematics proficiency for eighth-grade males in 1990. 
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TABLE 12A 



Average Fourth-Grade and Eighth-Grade 
Public-School Mathematics Proficiency by 
Gender 



Grade 4 


Grade 8 


1992 


1990 


1992 







* «* -Proficiency :% t 


\ < Proficiency' 


Proficlericy||||| 


Kentucky 


Male 


‘ Ir214: 


;t:i'259( lU) { 


\ **«.s«(8 , fi 1 4 } i v ; ; 




Female 




256 ( y 


‘260 U1,4) > t \' 


Southeast 








!i§.!!i-«S -f a SISJ m "< *’! i 




Male 


* 209 f i 


T- ; ! 253 ( 2i> < V:; 1 


•• '257 (,1.6) 




Female 


' _ 209 ( 27}, ,< / : 


5 1 { 255(23), - V 


i [; 259 ( 


Nation 






\:iY. 1 j: j i ! P V : j 






Male 


lU 218 ( 0.9)f IISI 


Off 262 ( : 17). E ff-Ci 


C«: i *266 ( 1I2) , 1 ‘ * 




Female 


v. ! 216 


, - 261 t (i,4)\ ; V ;h v ;t 





The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 
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GRADE 4 1992 
Male 
Kentucky 
Southeast 
Nation 

Female 

Kentucky 

Southeast 

Nation 



GRADE 8 1990 
Male 
Kentucky 
Southeast 
Nation 

Female 

Kentucky 

Southeast 

Nation 



GRADE 8 1992 
Male 
Kentucky 
Southeast 
Nation 

Female 

Kentucky 

Southeast 

Nation 



Percentiles of Mathematics Proficiency in 
Fourth- and Eighth-Grade Public Schools 
by Gender 



Trial State Assessment 


5th 


10th 


25th 
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90th 


95th 




Percentile 


Percentile 


Percentile 


Percentile 
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Percentile 
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M 94 ('2:0)1 
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•"213 C’lU) 
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llllnplgp 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. 



Table 13 presents mathematics performance by achievement levels. 



0 There was no significant difference between the percentages of fourth-grade males and 
females in Kentucky who were at or above the Proficient level (12 percent for females and 
14 percent for males). In addition, there was no significant difference between the 
percentages of eighth-grade males and females in Kentucky who were at or above the 
Proficient level (16 percent for females and 18 percent for males). 

• Also in Kentucky, about the same percentage of eighth-grade males were at or above the 
Proficient level in 1992 as in 1990. About the same percentage of eighth-grade females were 
at or above the Proficient level in 1992 as in 1990. 
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Levels of Fourth-Grade and Eighth-Grade 
Public-School Mathematics Achievement 
by Gender 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > ( < ) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. 



CONTENT AREA PERFORMANCE 



erIc 



Tables 14A-14F provide a summary of content area performance by race/ethnicity, type of community, 
parents’ education level, and gender. 
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TABLE 14A 



Fourth- and Eighth-Grade Public-School 
Performance in Numbers and Operations 
by Subpopulation 



Grade 4 
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1990 


1992 



TOTAL 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (< ) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14B 



Fourth- and Eighth-Grade Public-School 
Performance in Measurement by 
Subpopulation 
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TOTAL 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution - the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14 C 



Fourth- and Eighth-Grade Public-School 
Performance in Geometry by 
Subpopulation 
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The N AEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14D 



Fourth- and Eighth-Grade Public-School 
Performance in Data Analysis, Statistics, 
and Probability by Subpopulation 



Grade 4 
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TOTAL 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14E 



Fourth- and Eighth-Grade Public-School 
Performance in Algebra and Functions by 
Subpopulation 



Trial State Assessment 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate (fewer than 62 students). 
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TABLE 14F 



Fourth- and Eighth-Grade Public-School 
Performance in Estimation by 
Subpopulation 



1992 Grade 4 



1992 Grade 8 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). Estimation was not included in the 1990 Trial State Assessment. ! Interpret with caution - the nature of the 
sample does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable 
estimate (fewer than 62 students). 
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PART TWO 

Finding a Context for Understanding 
Students’ Mathematics Proficiency 




Trial State Assessment 



In its landmark undertaking to set standards for mathematics curriculum and teaching, the National Council 
of Teachers of Mathematics (NCTM) made numerous recommendations for reforming how teachers teach 
the subject and how students learn it. 20 According to NCTM, to improve the nation’s mathematics 
proficiency, all students must learn more, and often different, mathematics, and instruction in mathematics 
must be significantly revised. 

The results of the Trial State Assessment can be used to monitor students’ progress in achieving the NCTM 
recommendations and to examine both school and home contexts for educational support. The 
public-school students participating in the 1992 Trial State Assessment, their mathematics teachers, and the 
principals or other administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. These student, teacher, and school data help to describe some of the current 
practices and emphases in mathematics education, illuminate some of the factors that appear to be related 
to fourth- and/or eighth-grade public-school students’ proficiency in the subject, and provide an educational 
context for understanding data on student achievement. The data from the questionnaires also provide a 
means to examine changes in policies, instruction, and programs at the eighth-grade level between 1990 and 
1992 for those states and territories that participated in both Trial State Assessment Programs. 

The questionnaire results provide a broad picture of educational practices prevalent in American schools 
and classrooms. It is important to note that the NAEP data cannot establish cause-and-effect links between 
various contextual factors and students’ mathematics proficiency. However, the results do provide 
information about important relationships between the contextual factors and proficiency. 



20 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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In many instances, NAEP findings reveal that educational researchers* suggestions about what strategies 



work best to help students learn often go unheeded. For example, NCTM has recommended that teachers 
employ more hands-on activities and student-centered learning techniques. However, as described in 
Chapter 4, and similar to the findings from the 1990 NAEP mathematics assessment, NAEP data indicate 
that classroom work is still dominated by textbooks or worksheets. Also, it is widely recognized that home 
environment has an enormous impact on future academic achievement. Yet, as shown in Chapters 3 
and 7, and again similar to the findings from the 1990 NAEP mathematics assessment, large proportions 
of students still report spending much more time each day watching television than doing mathematics 
homework. 

The contextual information provided in Part Two of this report focuses on five major areas: instructional 
content, instructional practices and experiences, teacher characteristics, school characteristics and context, 
and conditions outside of school that affect instruction and learning. Part Two consists of five chapters. 
Chapter 3 discusses instructional content and its relationship to students’ mathematics proficiency. 

Chapter 4 focuses on instructional practices — how instruction is delivered. Chapter 5 is devoted to 
calculator and computer use, while Chapter 6 provides information about teachers and Chapter 7 examines 
students’ home support for learning. 
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CHAPTER 3 

What Are Students Taught in Mathematics? 



According to NCTM, curricular reform in grades kindergarten through 4 is necessary and must address both 
the content and emphasis of the curriculum as well as approaches to instruction. The need for reform is 
equally great in grades 5 through 8, where the current curriculum also does not match NCTIVTs ideal. 21 
This chapter focuses on curricular and instructional content issues in Kentucky public schools and their 
relationship to students’ proficiency. 



Table 15 provides a profile of the fourth- and eighth-grade public schools’ policies and practices in 
Kentucky. Some of the salient results obtained from the school and teacher questionnaires are: 

• According to the schools, more than half of the fourth-grade students and about half of the 
eighth-grade students in Kentucky (66 percent and 54 percent, respectively) were in public 
schools where mathematics was identified as a special priority. This percentage for eighth 
grade stayed about the same* from 1990 to 1992 (62 percent in 1990). 

• According to the schools in Kentucky, more than half of the eighth-grade students 
(69 percent) could take an algebra course in eighth grade for high-school course placement 
or credit. This percentage of students stayed about the same* from 1990 to 1992 
(60 percent in 1990). 

• According to the schools in Kentucky, 87 percent of the eighth-grade students were taught 
mathematics by teachers who teach only one subject. The percentage of eighth-grade 
public- school students who were so taught mathematics stayed about the same from 1990 
to 1992 (83 percent in 1990). 

• According to their teachers, about one quarter of the fourth-grade students and more than 
half of the eighth-grade students (25 percent and 61 percent, respectively) were typically 
taught mathematics in a class that was grouped by mathematics ability. For eighth-grade 
public-school students, this percentage stayed about the same from 1990 to 1992 
(61 percent in 1990). 

© According to their mathematics teachers, 81 percent of the fourth-grade students and 
47 percent of the eighth-grade students received four or more hours of mathematics 
instruction per week. 



* Recall that “about the same” means that the difference between these two groups, although it may appear large, is not statistically 
significant. » 

21 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 
1989); Professional Standards for Teaching Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 1991). 
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TABLE 15 



Mathematics Policies and Practices in 
Kentucky Fourth-Grade and Eighth-Grade 
Public Schools 



Trial State Assessment 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each population 
of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In comparing two 
estimates, one must use the standard error of the difference (see the Procedural Appendix for details). If the notation > (<) 
appears, it signifies that the value for 1992 was significantly higher (lower) than the value for 1990 at about the 95 percent 
confidence level. — Item does not apply to Grade 4, or comparisons to 1990 are not appropriate because of a change in the format 
of the question. In 1990, the students’ mathematics teachers were asked to specify the number of hours they spent providing 
mathematics instruction each week. In 1992, the form of the question was changed. Instead of asking the teachers to specify the 
number of hours, the teachers were asked to select from three options: that they spent (a) Two and one-half hours or less; 

(b) More than two and one-half hours but less than four hours; or (c) Four hours or more providing mathematics instruction per 
week. 
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CURRICULUM COVERAGE 



Course taking is related to mathematics proficiency because students who take more mathematics classes 
tend to learn more mathematics than those students who take fewer classes in this subject, or because 
students who are more proficient tend to take more mathematics courses and, in some cases, because the 
higher-achieving students are tracked into more advanced courses. 22 To place students’ mathematics 
proficiency in a curriculum-related context, it is necessary to examine the extent to which students in 
Kentucky are taking mathematics courses. Typically, all fourth-grade students take mathematics. All eighth 
graders, with very few exceptions, also take mathematics. However, the eighth graders take different types 
of mathematics courses, as shown in Table 16. 

• A greater percentage of students in Kentucky were taking eighth-grade mathematics 
(60 percent) than were taking a course in pre-algebra or algebra (38 percent). Across the 
nation, however, about the same percentage of students were taking eighth-grade 
mathematics (50 percent) as were taking a course in pre-algebra or algebra (47 percent). 

• Students in Kentucky who were enrolled in eighth-grade mathematics courses exhibited 
lower average mathematics proficiency than did those who were in pre-algebra or algebra 
courses. 

• A greater percentage of students in Kentucky were taking algebra or pre-algebra in 1992 
than in 1990. Across the nation as well, a greater percentage of students were taking algebra 
or pre-algebra in 1992 than in 1990. 



Further, from Table A16 (Page 154) in the Data Appendix: 23 

o A greater percentage of eighth-grade females (41 percent) than males (34 percent) in 
Kentucky were enrolled in pre-algebra or algebra courses. 

« In Kentucky, 39 percent of White students, 32 percent of Black students, and 21 percent 
of Hispanic students were enrolled in pre-algebra or algebra courses. 

• In addition, 59 percent of students attending schools in advantaged urban areas, 32 percent 
of students in disadvantaged urban areas, 33 percent of students in extreme rural areas, and 
37 percent of students in areas classified as “other” were enrolled in pre-algebra or algebra 
courses. 



22 Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. The State of Mathematics Achievement: NAEP’s 1990 
Assessment of the Nation and the Trial Assessment of the States . (Washington, DC: National Center for Education Statistics, 
1991). 

23 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides a 
corresponding table presenting the results for the four subpopulations — race/ethnicity, type of community, parents’ education 
level, and gender. Results for the region are contained in The 1992 State of Mathematics Achievement: NAEP’s Assessment of 
the Nation and the Trial Assessment of the States. (Washington, DC: National Center for Education Statistics, 1993). 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. The percentages may not total 100 percent because a small number of 
students reported taking other or no mathematics classes. ! Interpret with caution -- the nature of the sample does not allow 
accurate determination of the variability of this statistic. 



82 



o 

ERIC 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



Kentucky 



MATHEMATICS HOMEWORK 



To examine the relationship between homework and proficiency in mathematics, the teachers of the 
assessed students were asked to report the amount of mathematics homework they assigned each day, and 
students were asked to report the amount of time they spent on mathematics homework each day. 

Table 17 reports the teachers 1 and students 1 responses. 



As reported by their mathematics teachers: 24 

• In Kentucky, 8 percent of the fourth-grade students and 3 percent of the eighth-grade 
students were not assigned any mathematics homework each day. 

• In addition, 1 percent of the fourth-grade students and 5 percent of the eighth-grade 
students in Kentucky were assigned an hour or more of mathematics homework each day. 

• The greatest percentage of fourth-grade students were assigned 15 minutes of mathematics 
homework each day, and the greatest percentage of eighth-grade students were assigned 30 
minutes of mathematics homework each day. 



According to the students: 



• In Kentucky, 7 percent of the fourth-grade students and 1 1 percent of the eighth-grade 
students did not spend any time each day on mathematics homework (either none was 
assigned or the students did not do the homework). 

• In addition, 16 percent of the fourth-grade students and 14 percent of the eighth-grade 
students in Kentucky spent an hour or more on mathematics homework. 

• In grade 8, average mathematics proficiency was higher for students in Kentucky who spent 
30 minutes on mathematics homework than for students who spent no time on 
mathematics homework each day. 

• From 1990 to 1992, there was no significant difference in the percentage of eighth-grade 
students who did not spend any time each day on mathematics homework (11 percent in 
1990 and 11 percent in 1992). 

• From 1990 to 1992, there was no significant difference in the percentage of eighth-grade 
students who spent an hour or more each day on mathematics homework (14 percent in 
1990 and 14 percent in 1992). 



24 Comparisons between 1990 and 1992 are not possible for the teacher responses because of changes in the form of the questions 
that they were asked. 
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The NAEP mathematics scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with 
about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see the Procedural 
Appendix for details). If the notation > (<) appears, it signifies that the value for 1992 was significantly higher (lower) than the 
value for 1990 at about the 95 percent confidence level. — Comparisons between 1990 and 1992 are not possible for the teacher 
responses because of changes in the form of the questions that they were asked. ! Interpret with caution - the nature of the sample 
does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate 
(fewer than 62 students). 
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INSTRUCTIONAL EMPHASIS 

According to NCTM, the teaching of computation and other traditional skills has dominated the 
mathematics curriculum at grades kindergarten through 4, while at grades 5 through 8, a repetition of topics, 
instructional approaches, and presentation have prevailed. In contrast, NCTM recommends that students 
be taught a broad range of mathematics topics, including number concepts, computation, estimation, 
functions, algebra, statistics, probability, geometry, and measurement. 25 

Because the Trial State Assessment questions were designed to measure students’ knowledge, skills, and 
understandings in various content areas -- regardless of the type of mathematics class in which students were 
enrolled -- the teachers of the assessed students were asked a series of questions about the amount of 
emphasis they gave to each of five mathematics topics during the school year. Each topic corresponded to 
one of the five mathematics content areas included in the Trial State Assessment — Numbers and 
Operations; Measurement; Geometry; Data Analysis, Statistics, and Probability; and Algebra and 
Functions. The teachers’ responses provide an indication of students’ opportunity to learn those topics 
recommended by NCTM. 

The teachers were asked whether they were placing “heavy,” “moderate,” or “little or no” emphasis on each 
topic. Table 18 provides the results for this analysis and the average student proficiency in each content 



From Table 18: 

• In Kentucky, 91 percent of the fourth-grade students had mathematics teachers who placed 
heavy instructional emphasis on Numbers and Operations, 21 percent had teachers who 
placed heavy instructional emphasis on Measurement, 9 percent had teachers who placed 
heavy instructional emphasis on Geometry, 11 percent had teachers who placed heavy 
instructional emphasis on Data Analysis, Statistics, and Probability, and 1 percent had 
teachers who placed heavy instructional emphasis on Algebra and Functions. 

• In Kentucky, 77 percent of the eighth-grade students had mathematics teachers who placed 
heavy instructional emphasis on Numbers and Operations, 20 percent had teachers who 
placed heavy instructional emphasis on Measurement, 22 percent had teachers who placed 
heavy instructional emphasis on Geometry, 15 percent had teachers who placed heavy 
instructional emphasis on Data Analysis, Statistics, and Probability, and 50 percent had 
teachers who placed heavy instructional emphasis on Algebra and Functions. 

• Comparisons between 1990 an 1992 for two content areas — Numbers and Operations and 
Data Analysis, Statistics, and Probability — are not appropriate because of changes in the 
form of the questions that the students’ mathematics teachers were asked. There was no 
change in the percentage of eighth-grade students whose teachers placed heavy instructional 
emphasis on Measurement, Geometry, or Algebra and Functions from 1990 and 1992. 



25 Curriculum and Evaluation Standards for School Mathematics. (Reston, Va: National Council of Teachers of Mathematics, 



area. 



1989). 




85 



NAEP TRIAL STATE ASSESSMENT 



79 



Kentucky 



THE NATION’S 
REPORT 
CARD 



1992 



TABLE 18 



NUp 



Teachers’ Reports on the Emphasis Given 
to Specific Mathematics Content Areas 



Trial State Assessment 



Grade 4 


Grade 8 


1992 


1990 


1992 



Teacher " emphasis" categories by content areas 



Numbers and Operations 
Kentucky Heavy emphasis 



Southeast 



Nation 



Measurement 

Kentucky 



Southeast 



Nation 



Geometry 

Kentucky 



Southeast 



Nation 



Little or no emphasis 
Heavy emphasis 
Little or no emphasis 
Heavy emphasis 
Little or no emphasis 

Heavy emphasis 
Little or no emphasis 
Heavy emphasis 
Little or no emphasis 
Heavy emphasis 
Little or no emphasis 

Heavy emphasis 
Little or no emphasis 
Heavy emphasis 
Little or no emphasis 
Heavy emphasis 
Little or no emphasis 



Data Analysis, Statistics, and Probability 
Kentucky Heavy emphasis 



Southeast 



Nation 



Little or no emphasis 
Heavy emphasis 
Little or no emphasis 
Heavy emphasis . 
Little or no emphasis 



: percentage 
proficiency- 

i l : "! l:j:i t Vc \ Hasi! 
jig:* <, < 

fflllliillll 

1.2> lt , ‘ 

III 92 ( 2481 
||!^P?p} 

i41l 

|p( 

1 rs;:( o.i) ' j 



fv24,T3.3)?S 
2l7i,(.2.4) 1 ‘ 
? CL'l)^ 

lias ( 

,215 (2,7)1. 

i 9®( 0.7) 

•* j 

?i r 14 ( 1,7)13 

217 (a2'j6) : y= 
>> 6 (1.2) - 
;221'( 3.8)1 

m < 2.1) 

: 216 ( 3.?)i; 

210 < 21.6)1 

Ife islpi 

SIOT 7.8)1 
Sis ( 4.7}!; 
.208 ( 3.7)! 

<• 1.1).' 

212 ( 5.0) 



:ft22'<:2.8) Hd 



,( '3.2)1. " 

pliipl6) 

' ! 21i*',( 2.7} . | 

iilla^) ,, 

224(1 1.2jP;C 

|20S;.(2.5) : .; 

1 222 ( 4.2) 

52 (2.8) :' :!; 
. 215 



\ { /Percentage 

V*. and ; 1 : 

1:| Proficiency .; 

* , A' 'CL : . t! K t< ! '< 

'•v t . 

r* ./.,v 

aissMrvMtf* 

- 1 -'-) , " 

iC'«tiT 2 4 ".j. 

iilHi6.8) 

: y.M 242 ,( 6 . 2)1 , 

rtf, < m Vb.-iT'^v 

|yi;:',';i 7 ( 3 . 0 } - /:?• 
:. ;.!*;• !?50 

? "272 (; 3 . 9 ) / •' 

: , 257 ( 2 . 2 ), 

, 26 ( 3.4) 

;;vi 1 :^^ 2 . 5 ) -is; 

. 22 j: 7 ; 0 ) ?i|; 

253 ( 5 . 8 )i 
‘ 22 (8.8) V 

. ,;■■■; 254';( 9.4)! tfu, 

; ,. 259 ( 3 : 6 ) 

*,*< ‘.‘..21 ( 3 . 3 ) 

284 ( 54 };|r*J;i 

:: ::::::: : : r ' ! : ; : : : c ‘ = 

l*|;f ;i'" 

u: 

•v.:; 

lift 



Percentage i 

- and , / : ” 

|il |f Proficiencyi ; 1 

1|}^3 ( e o 4 v-v : ‘ 

• «ij ( t ; r 

W? f ; 

lllll ‘^267 ( 14 . 9 ) 1 1 | } > 

W^S^fi l: I 

?\ f" t 4 (b: 6) C $V; 

... \ ' , ‘t t <{ J \ l 

20 (,^>:v ' 

; 259 ;( 3 j|S|?e 

sasiii|44;l r s 

: .x : :: : 2&l|ii|4.‘!,tf , 

llilr.: 9 ^( 2 : 6 i;::; ! f:|! 

> 2 :(.S. 4 )S 

■r-j I : t 6 i 2 . 0 )‘; ;■’/ 



jfflpBf ... 

fv 5 Ills 

If" .281 ,( 34) 

gi|pp(:; 2 : 6 ) t||; 

SI': 259 ( 4.8)1 

fis u &. 9 ( 2&f 

i 957 ( 

1 : 263 t (-2:3} : ' 
V ‘ ' 11 i 114) 

264 ( 4 . 4 ) 

« 15 ( 2-1} 

|p|l||854?jS 3.9 ).;,:? kS! 

- - 275 ( 6.9)T‘ 

Vy- : • 29 ( 2^) . . ’ 

<f t 273(4.8) • 

>t ! ‘: 30 2.0) : 

< . 28$i2sy < : 



86 



(continued on next page) 



3 

ERIC 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



